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Foreword 


This is a toolbook. 

It can be used either as a text or a reference by people 
studying or doing such things as project analysis. 

In principle, analysis is the mother of rationality. The 
word analysis labels a large array of orderly efforts to 
transform the imponderable into the manageable. People 
try through analysis to identify the key properties of 
problematical situations, to contrive promising solutions, 
znd to frame these solutions in convincing ways. 

Three things affect the success of such efforts—the 
nature of the “reality” being examined, the pourer of the 
arialysis tools that are used, and the decisional arrange- 
ments to which analysis contributes. What is out there and 
our interest in it set the basic requirements of analysis. The 
tocls and their use determine what we see and influence 
what we then try to do. This volume focuses upon tools 
their uscs. It indicates how they can be applied to 
study various kinds of realities, or to imposing 2 sense of 
¢rder upon real-world concerns. It does not address the 
zhird factor which affects the success of analysis efforts— 
the decision-making settings in which the tools are 
eed. 

The trend of our times is to demand more and better 
az.zlysis tools in order to try to solve increasingly compli- 
czted problems through planned, managed action. The 
scictions often breed new problems. The expanding pres- 
sire to diagnose and resolve outruns our ability to re- 
ssond. One American sociologist speculates that the ulti- 
mzte outcome of this dynamic imbalance might be the 
czllzose ef societies in “the stupidity death,” as the needs 


+o interpret and manage fatally exceed the capacity to do 
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No single book will solve that problem. This one 
- make some incremental contributions to the inrelli- 
use of analysis in sensible problem-definition and 
!-Sommed solution-seeking. For example, it presents a wide 
sazze of analytical tools—zbout forry—and it classifies 
into nine functional categories, from methods of 
ideas to techniques for controlling and evalu- 
ts. There is an important implication here: there 


are many kinds of analysis which can be used foravaricty 
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does this matter? Partly because the formal anal- 


tesof social and economic change organizations 
e selective. They ars usually skewed in 
eccain kinds of issues end techniques. The pat- 
Lis bock at least shows thu: there are significant 
Aes cf anal: sis beyond the economic and Ainancisl, 


= 3 2 2 a 
2 hevond dezerminate systems techniques fer piann-ng 


implementation. This is important because some of the 
best-established, most conventional techniques of anal- 
ysis, used undiscerningly, make it possible to design un- 
workable programs and projects: 

This book reflects another important idea: analysis is 
not solely the province of insulated experts with little 
responsibility for entrepreneurship or implementation. 
Some of the techniques presented here are as useful to 
“operators” as to “‘analysts.”” All of them can profitably 
be understood by people primarily concerned with pro- 
moting and executing projects. 

In practice, the interplay of analysis and action is quite 
complicated. How it works depends chiefly upon the third 
factor mentioned at the beginning of this brief essay: the 
decisional arrangements to which analysis contributes. 

In most organizations which rely upon analysis as an 
importent input into decisions about programs and proj- 
ects, systematic analysis and decisional action tend to be 
rather loosely linked. 

A good part of this looseness is necessary and desirable. 
Studying things and doing things are frequently very dif- 
ferent kinds of activity engaged in by different kinds of 
people. Even so, decision makers and people with discre- 
tionary responsibility for executing decisions had better 
understand the nature—and the limitations—of the ana- 
lytic techniques upon which their decisions and their man- 
dates may be based; just as analysis specialists will be wise 
to perceive the practical usefulness of their products and 
the limits thereof. 

Various kinds of analyses produce knowledge for use in 
designing, reviewing, deciding, and executing programs 
and projects. Such analysis, coupled with criteria about 
goals and standards, helps produce decisional frameworks 
and programmatic targets. It also helps produce decisions 
about particular plans or proposals: Do they fit within the 
frameworks? Are they likely to achieve acceptable tar- 
gets? By helping answer these questions, the analysis may 
reduce the uncertainty of efforts to shape the future and 
lessen the need to rely upon hope and intuition. Even 
when uncertainty defies dissipation, the authontative use 
of systematic analysis techniques imposes a degree of 
order and focus upon decision making. 

Order is a much valued quality in circumstances where 
uncertainty abounds. It is also a limited, potentially per- 
verse quality. The quest for order sometimes buries real 
uncertainties beneath exhaustive analyses. These analyses 
tools apply techniques which look like formulas or recipes 
for calculating, deciding, and planning. They are often 
treated as if they are formulas or recipes. But they are not 
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decisional recipes. Analysis techniques only produce 
ingredients for cooking in decision-making pots, and for 
envisioning the future. With sufficient skill and judgment 
these ingredients—the products of analysis—can be used in 
cooking up programs and projects. But they are readily 
misused too. 

The tendency toward misuse is encouraged by the lop- 
sided, unbalanced quality of our aggregation of tools. The 
more intrinsically determinate the tools, the more attrac- 
tive they are. Economic analyses and financial analyses, 
and schemes for “mapping” formalized plans of action 
(which are actually techniques for hopefully idealizing 
what is intended), are attractive. Quantitative analyses of 
costs and benefits, of cash flows, of sensitivities, and so 
forth, produce determinate answers, even if important 
data must often be stipulated. Projected maps of future 
sequences of events have the appeal of apparent certitude, 
even if they do not tell us how these Sequences are going to 
be caused and controlled, or how plausible they are. 

To say these things is not to reject the merit of quanti- 
tative analyses and precise-looking maps of future courses 
of action. Both can be valuable, just as both are dangerous 
in the hands of those who take the products a3 “‘true.” 
Unfortunately, these intrinsically determinate techniques 
are not matched and balanced by methods for analyzing 
how best to organize the activity, how to determine mara- 
gerial resource needs and ways to meet them, how to 
specify the incentives which will increase the probability 
of success, and how to measure the full range of effects. 
Our tools for doing these latter things are at best rather 
messy and imprecise. So decisions tend to turn more upon 
the findings and projections of the neater tech niques; and 
endless effort goes into refining and applying them. 

This general observation is reflected in the contents of 
this book. It does present heuristic techniques for address- 
ing some of the troublesome problems of design—gener- 
ating ideas, pinning down objectives, and trying to map 
complex relationships, for example. But, understandably, 


much of its bulk presents relatively determinate comouta- 
tional tools. Because these are the tools we have. 

A longer essay on the interplay of analysis and iczic 
would address other important aspects of the subject, such 
as the use of analysis to manipulate consent and acces- 
tance and the manipulation of analysis to secure acce>- 
tance for for proposals. The function of analysis in the 
decisional processes of development agencies is not 
limited to the uncontaminated generation of unassailable 
objective premises, nor can it ever be so limited. 

But the ultimate justification of analysis as a kizd of 
activity is its contribution to better knowledge, bexer 
understanding, better decisions—to the reduction of es 
and the enlargement of human capacities for auspicicus 
action. It is to these aims that this toolbook is dedica-ed. 

The book itself is the eventual product of a giein 
put to two young industrial engineers at the University of 
Wisconsin a few years ago: “What sorts of tools and zech- 
niques do you people use in defining problems and shaping 
solutions which might be transferrable to the field of eco- 
nomic and social development?” Here are the answers pro- 
vided by Professors Delp and Thesen and their associates. 

These answers are neither exhaustive nor definitive; 
there is little limit to the full array of tools that might be 
cited. Many of the individual tools offered here are them- 
selves subjects of more than one book. But this workisa 
valuable introduction and overview. Each tool is presented 
in a way which facilitates intelligent judgment about its 
use. The tool descriptions are buttressed by citations 
which enable the reader to pursue topics of special inzer- 
est. 

If this book should somehow cause one consequential 
error to be avoided, in the design or implementation of a 
single project significantly affecting the lives and well- 
being of some people, the enterprise which has produced it 
will stand justified. Given the limits of our ability to ana- 


lyze certain kinds of cause-effect relations we shall never 


know. 
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Director 
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Preface 


The word “‘tool,”’ in its strictest sense, refers to an im- 
plement, a means for effecting some purpose. When we 
started the project which led to this volume, we used tech- 
niques, methodologies, and tools synonymously to de- 
scribe various means for planning. On reflection, perhaps 
the stricter definition is also inappropriate, for this collec- 
tion represents a set of implements—tools for implement- 
ing a systems approach to planning. 

Systems, system models, and the systems approach 
tend to blur together into a conceptual mass whose tan- 
gible aspects are represented as tools. We've called them 
“system tools,’’ not because they are necessarily derived 
from systems concepts or systems engineering, but be- 
cause they are tools which facilitate a systems approach to 
planning. A systems analyst uses techniques which shape 
plans from a systems perspective. The wholistic, future- 
onented, inter-relatedness of systems thinking models the 
iscation facing development planners—situations filled 
with myriad interdependencies, uncertain futures, an ill- 
defined present, and a data-deficient past. The alternatives 
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Action-oriented development activities are imple- 
mented as policies, programs, or projects. We have used 
the project concept to represent both programs and poli- 
cies in the sense that one or more projects are specific ac- 
tides in order to implement a program or policy of ac- 
_The distinction between a project anda system is not 


‘sis used to evaluate 1) alternative components ofa 
2) alternative systems, or 3) alternative projects 
y involve many interacting systems). In many 
zses. techniques for project design and techniques for 
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Ceses, ce 
evetem design are indistinguishable. 

Ples.ning, as we have used the term, encompasses the 
entice range of activities associated with achieving devel- 


~entends. Planning a project requires that all aspects of 
roject be designed or specified. This includes identi 
‘ectives, sub-objectives, and criteria for evaiueting 
vement of objectives. It includes specifying the 


2": of implementation—those messy details of get- 
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porated into the design and that the essentials of evalu- 
ation be considered in the planning process. Short-term 
feedback systems to provide management information are 
designed to complement long-term feedback of project 
impact in order to inform development planners. This 
broad view of planning and its intimate connection toim- 
plementation has guided our selection of techniques and 
their descriptions. 

One aspect of the descripcion which needs elaborating 
is our distinction between decision makers and analysts. 
Certain techniques require special skills for successful im- 
plementation (e.g., Surveys, Cost-Benefit Analysis). An 
analyst, possessing these needed skills, may also be the de- 
cision makes. In some techniques the two roles are distinct 
(Delphi, Program Planning Method), while in others the 
separation of roles is not important. A decision maker has 
discretionary control over resources including these se- 
quired for analysis. Therefore, he views the prcblemis of 
project planning from a different perspective from the 
analyst and usually a different degree of accountability. 
This reflects not only the way techniques are emiployed, 
but the decision to employ a particular tool. The classic 
case is an analyst who needs information recommendinga 
sampie survey, and the decision mzker reconsidering this 
approach because of political sensitivines. We have in- 
cluded this distinction where relative to the application of 
the technique. 

While we have sought to be comprehensive in our cover- 
age of systems tools for planning, we recognize the omis- 
sion of a great body of planning techniques developed in 
such fields 2s econometrics, business, and operations re- 
search. Linear programming, input-output mode!s, or ma- 
trix algebra are useful planning tools, but they representa 
level of sophistication, a rigidity of models, anda depend 
ency on accurate data and computer implementation 
which seem inappropriate for the intended audience of 
this volume. 

This collection of techniques and methodologies is in- 
tended for practitioners in the many diverse fields in 
which development touches both the peoples’ lives and 
livelihood. Our examples are drawn from agriculture. edu- 
cation, health, femily planning, employment, and re- 
source menagement tounderscore our belief in the univer- 
sal utility of these tools in planning. We have focussed on 
project design and implementation as the action interface 


of planned development. 
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Introduction 


Designing development Projects requires some form of 
“systems” approach. If any plan is to succeed, the factors 
thet will probably determine the outcome must be identi- 
fed, and their relationships must be established. There 
will elways be surprises as implementation proceeds, for 
our ability to predict and control the future is limited. The 
object of planning and design is to keep those surprises ata 
minimum. A systems approach, properly used, can serve 
There is another justification fora systematic approach 
Project plenning and design: Even the sim plest interven- 
as have secon dary etfects—consequences which are 
easily overlooked because they are incidental oreven irrel. 
rant to the project itself. An irrigation project, designed 
20 raise farmer income through increased productivity, 
may threaten established social and economic relation- 
suiss. It mzy introduce water-borne disease vectors, It 
may have other unintended conseqzences which, in some 
Cas25 a7€ More important than the direct impact of the 


prcect. 
Iz the West, the word “systems” has acquired, for some 
peozle, a certain Magical quality. The term is used promis. 
Clcusly, vaguely, and enthusiasticaily. The problem lies 
‘= the meaning of that term, -utin the Way in which it 


ceprually, a system is simpty « set cf interac-ive ele. 
278. In conventiong] usage, the term refers ty a set of 
stors which are known (Or assumed) to be necessary and 
stent [0 some Perpose or cffect. Systems thinkers 


often work backward, beginning with a desired objective 
and then determining what factors are needed to accom- 
plish that objective and how those factors must be related. 
The success of this approach to design depends not on the 
use of the term “system,” but on the ability of the design- 
ers to truly know what is necessary to the desired effect. 

There are many areas where such knowledge exists, for 
example, in designing an electric motor, an 2utomobile, an 
atrplane, a computerized data processing program, or a 
water control system. In these and similar examples, the 
system can he thought of, for all practical rircoses, as 
“closed.” It is a tidy system. There is relatively perfect 
knowledge of its Parts, and of their relation to a desired 
effect. And the essential relationships between the system 
and its environment can be known and controlled. 

Problems arise when this alluring idea of “system” is 
transferred from the fields of determinate design into the 
messy world of “open systems.” These are loose and not 
necessarily stale arrangements in which the environment 
of an action system, such as a government program, an 
enterprise, or a farming venture, is always affecting the 
working of that system, 

In the language of systems, the “environment” consists 
of the factors which affect the system's working but which 
are not subject to full control from within the system. The 
Weather is an important environmental factor in acricul- 
tural systems. ‘'Politics” constantly affects the behavior 
and potential of a bureaucratic Program system. In short, 
pen systems are not nearly so determinate Or so capable 
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of precise specification as the more closed systems of in- 
sulated engineering. There are two potential dangers in ap- 
plying the idea of a system to designing development proj- 
ects. 

The first is the danger of failing to identify essential ele- 
ments of an open system, or to effectively judge their 
probable working. A systems perspective cannot guar- 
antee against this danger. It cannot tell you ahead of time 
what the factors are or how they will work. It can, how- 
ever, make you aware that they exist and that you had bet- 
ter try to find and assess them. 

The second danger might be labeled “undue narrow- 
ness,” the danger that “incidental” effects may be ignored 
or undervalued. This can result from systems analyses 
which, as noted above, start with some desired aim or goal 
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ficient factors for meeting the goal without also consider- 
ing the other effects which those factors will have. 

It is possible to examine and analyze the larger array of 
effects produced by any system. Some systems ap 
proaches fail to address this vital matter, but ortly a broad 
systems perspective can consider these effects in a reason- 
ably orderly way. Therefore, the systems approaches re- 
flected in this collection of tools and techniques are com- 
prehensive. The aim is to help people search systematically 
for the broad implications of planned change. The ap- 
proaches supported by these techniques are futire- 
oriented. They offer help in trying to forecast immediate 
and longer-term effects in open systems designs. The ap- 
proaches supported by the following tools are essentially 
pragmatic. They address the realities of the socio-political 
environment of any of the kinds of systems likely to con- 


é 


cern us. 
In these approaches, the systems analyst attempts to 


deal with unbounded complexity by identifying a set of 
salient variables which describe the problem. The organiz- 
ing concept is the notion of a system, defined not as a 
static but as a dynamic entity. The values of descriptive 
variables and the status of relationships are projected into 
the future in order tolookat the consequences of planned 
‘nterventions. The systems designer recognizes both the 
limitations of deterministic anal ysis and the realities of 
power as it invariably affects the best laid plans. Conse- 
quently, a hallmark of a systems approach is pre-planned 
adaptability. Adaptive systems are better equipped to deal 
with uncertain futures, the vagaries of power, and the real- 
ities of complex political, social, and technical interac- 
tions. 

Engineers have long straddled both hard and soft ap- 
proaches to problems. In true engineering fashion, he/she 
uses whatever technique fits the task or promises insignts 
ns. For the non-technical aspects of problems, 
s engineer must turn Co other disciplines. 


into solutio 
the system 


APPLYING ASYSTEMS APPROACH 


$ 
logic and sequence of complex computer progacs. Net, 
much imagination is required to adapt the technigue to 

the complex decision processes confronting deveicpmeat 
planners. The aim for design remains the same: using the 
technique to understand the determinants of decision and 


7e 


‘ 


action. 


This adaptation of systems technology (scfrware) + 
the complex realm of human behavior is a two-way 5e2t 
Behavioral scientists have developed systems onented 
techniques which have been readily adop ted by seajecodes 
signers. Brainstorming (BSG, page 3) and Nominal Group 
woe re Pea a Pee: epee are f 
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small group theory and empirical creative process analysis. 
System designers utilize the techniques because of cheir 
demonstrated power in generating ideas and incovative 
solutions. 

Criteria used for selecting (or excluding) techniques 
from the volume were based on the needs of the incenced 
audience. Many sophisticated techniques utilizing spami- 
zation theory and computer technology fill the s;stams 
literature and seem inappropriate for me=ting the needs of 
a project planner in the field. Consequently, linear pro 
gramming techniques, queuing and game theory, inptt- 
output models, and cross-impact matrices have not been 
included. By and large nothing more sophisticated than a 
pocket calculator is required for any of the tcols. The ex- 
ception is Computer Simulation Models (CSM, page 120), 
which was judged sufficiently important that a summary 
description was included. Complex mathematical formu- 
lations have been avoided, except where a step-by-step 
procedure can be described (see Regression Forecasting, 


RGF, page 160, and Discounting, DIS, page 184). 


TOOL DESCRIPTIONS 


Each tool describes what the project planner needs to 
know in order to 1) selecta tool, 2) utilize the tool, and 3) 
understandits implications and underlying theory. 

To aid selection, each tool begins with a brief statement 
of purpose and asummary of uses. A short description fol- 
lows (supplemented by key definitions) and is augmented 
by a listing of advantages and limitations. The decision 
maker is thus given a brief overview of the tool to help him 
decide if the technique is a candidate for addressing a 
problem. To this end, a section on required resources (ef- 
fort, skills, time) concludes the first part of each tool de- 


scription. 
In order to use a tool, a detailec description is needed, 


beginning with required inputs, expected outputs, and im 
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portant assumptions. Moving trom inputs to outputs in- 
volves a procedure, which is described for the tools at dif- 
fering levels of detail. An example illustrates the proce- 
dure. 

Finally, a brief section on the underlying theory anda 
bibliography conclude the tool description. Together with 
the listing of assumptions and limitations, these attempt 
to give each tool a theoretical base, while leading the 
reader to additional sources. 

Ideally, each tool description should be self-sufficient, 
but in order to save space and provide essential continuity, 
the prerequisites of each tool precede the description. For 
example, the description of cost-benefit analysis (CBA, 
page 212) takes the form of a summary linking prerequi- 
site tool descriptions comprehensively. In some cases, a 
common example is carried through several tools. 

The examples draw on a broad range of problems and 
sitzatons confronting project planners in the develop- 
ment fields, ranging from education and health to agricul- 
ture and economic policy. Most of the examples refer to 
the developing country of Temasek which (for conven- 
lence) has a widely varying climate and diverse ecological 
zones. The population is mostly agrarian. The examples 
are Ccaun from first-hand experiences, hypothetical situa- 


nens, orthe literature. 


USING THE SYSTEM TOOLS HANDBOOK 


The tools included in this volume fall into anumber of 
categories: generating ideas; assessing qualitative factors; 
cefining objectives; describing complex relationships; ana- 
lyzing complex processes; accounting for alternative out- 
comes; forecast and prediction; analyzing projects; and 
Flesninz, controlling, and evaluating projects. Clearly, 
many techniques could be included in more than one cate 
gory. For example, computer simulation models (CSM, 
paz 129) could be used for the last six purposes listed. It 
is presented in analyz ing complex processes because that is 
he most bzsic use of computer simulation. 

Fezk t6o) i desiened to standalone asasource of infor- 
mation for a decision maker, as an aid to the analyst, and 
cztalyst for multidisciplinary desicn teams. The tool 


cescription (together with any prerequisite tools) provides 


models used by analysts). 


DEVELOPING SYSTEM MODELS 


me 
> 4h 


#¢ tools are paramount to the Cescription of any 
syscem: Gree Diserems ‘TRD, page 74). Ova! Diagram- 
OVD, peze 81). and Interacion Matix Diagram- 
i. page $2. Bach desertbes che complex relation- 
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ships of a system and defines a system as distinct from j 
environment. 

One possible sequence for using the tools is given j 
figure la. The analyst uses a tree diagram (more specifix 
ally, an influence tree) to develop the relationships whic 
prescribe system behavior. This le a specification ¢ 
system variables and environmental factors which inf], 
ence variables within the system. At some point, the tre 
diagram is redrawn as an oval diagram to show the feed 
back relationships and multiple interactions of system var 
iables, If the oval diagram becomes too unwieldy, the ana 
lyst may turn toa matrix description. This has the distinc 
advantage of systematically pinpointing every possible in 
teraction among system and environmental variables, 
while refining the oval diagram. 

The analyst may wish to begin with zn interaction ma- 
trix diagram rather than a tree diagram (see figure 1b). 
This approach appeals to those who are more comfortable 
separating the identification of variables from the specifi- 
cation of relationships. A tree diagram oz an oval diagram 
is then used to interpret the interaction matrix in a form 
which permits tracing the sequence of cause and effect_An 
interaction matrix diagram is particularly: useful in break. 
ing down information-gathering and anzlysis tasks into 
distinct groups, thus facilitating task assicn ments. 

The oval diagram constitutes a first attemptat a causal 
model of the system; it Presents an explicit statement 
about key variables as well as hypotheses ebout cause and 
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effect relationships. These hypotheses may be tested by 
regression analysis (see RGF, page 160) and then quantita 
tively modeled. The oval diagram is then used in various 
ways to gain greater understanding of system behavior (see 
figure 2). For example, a computer simulation model 
(CSM, page 120) can be constructed in order to predict the 
consequence of changes in the system. A scenario (SCN, 
page 16+) may be developed using the oval diagram as a 
basis for describing the base state and the kinds of changes 
expected in the future. 


FIGURE 2 
OVD 


GENERATING AND ANALYZING ALTERNATIVE 
PLANS OF ACTION 


Tree diagrams in the form of ends-means diagrams (sce 
TROD, page 74) are useful for breaking a system into com- 
ponents or an objective into alternative means. This begins 
a sequence using several techniques to analyze alternative 
plans (see figure 3). The central tool in this process is the 
Decision Tree (DTR, page 141). Branches of a decision 
tree map alternative actions and probabilistic outcomes. 
The alternatives may be identified by the tree diagram 
branching process or the matrix format of morphological 
analysis (MPA, page 10). The probabilities of various out- 
comes are often subjectively assessed (SPA, page 137). 
Closely related to the decision tree, contingency analysis 


FIGURE 3 
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(CGA, page 147) tabulates alternative plans against the 
various possible states of nature which affect their our 
comes. 

Outcomes for both techniques are expretees 2ither as 
monetary units (costs and tenefits) or as utuites, using a 
concept which translates preferences for an cutcome into 
a dimension on an interval scale (see RTS, paze 29}. Urili- 
ties assessed for various criteria are combined in Mulzple 
Criteria Utility Assessment (MCU, page 32). 

In short, these possible sequences of tools (Egure 3} de 
scribe a process of analysis which begins with generating 
alternatives and results in an evaluation alesis out 
comes, The end use may be employed fora cost 
analysis or for the selection of plan elements. 


ee 


CO-OPTING CLIENTS, RESOUKCE CONTROLLERS, 
AND EXPERTS INTO THE PLANNING PROCESS 


There is a set of techniques which claim their greatest 


~ 


strength in their ability to generate cooperation among 
various actors on the planning stage. The central rool is the 


Program Planning Method (PPM, page 227). Supror-irg 


this tool are anumber of techniques, each of which is pow- 
erful when used alone and potentially more so when incor- 
porated into a strategy (see figure 4). The Nominal al Group 
Technique (NGT, page 14) permits maxmmum 1 efficien ncy 
in generating ideas. It is particularly effective when used 
by diversely composed groups. 7) 

A companion technique is the Delphi process (DLP, 
page 168) to which experts and decision makers contri- 
bute without face-to-face confrontation. This anonymity 
is often necessary if the pursuit of ideas and constructive 
problem exploration is not to be hindered by social and 
bureaucratic sanctions. The Delphi utilizes repeated 
rounds of questionnaires (QTN, page 19). 

The Program Planning Method combines these tech- 
niques to produce plans which co-opt clients, resource 
controllers, and experts in a carefully orchestrated plan 


ning process. 


A NORMATIVE APPROACH TO PLANNING 


One planning strategy begins with a normative concept 


of the ideal system, rather than analyzing what could be 
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wrong with the existing one. This strategy is embodied in 
the IDEALS Strategy (IDL, page 231). Two other tech- 
niques support this approach (see figure 5). 

Function expansion (FEX, page 45) forces the system 
designer to think in terms of the purpose of the system 
desired—what the system should be doing. This leads toa 
specification of the “ideal system target’”” which becomes 
the basis for designing a feasible system, using essentially 
the system design strategy. The form of the specification is 
the system definition matrix (SDM, page 67), which is the 
output of the IDEALS process. 

Focusing on function rather than on problems gets peo- 
volved in a constructive assessment of what should 


wee 
a rather than what’s wrong and who’s to blame. There 
are sound arguments for both approaches. The IDEALS 

tategy oftencomes under attack because its emphasis on 
normative specification may possibly ignore experiences 
ezined fom problems with the existing system. If the ideal 
system target proposes a radical change, where only incre- 
mental changes are acceptable, normative Prescriptions 
may be counterproductive. Still, there is an intuitive ap- 
peal to anv process that encourages minds to explore an 
unlimited problem solution space, unbounded by existing 


system descriptions. 


INFORMATION 


A seguence of techniques is particularly useful for gath- 


erng information across a broad spectrum. The Principal 
technisue is the sample survey (SVY, page 36), which be- 
is the desizn of the survey questionnaire (see figure 6). 
here ssbiective assessments are to be quantified end ag- 
ecaced, the gx esticnnaire may incorporate Tating scales 
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The guesdoanaire (QTN, page 19) must ke pretested 
2x2 reSnedso che: the objectives of the survey may bere 


aized. The means for obtaining the desired information 
atly, bet one usefy] technique is the direct 
ee INW’, paze 23). This is usually the preferred 
etesting the survey because it requires less 
tine ind eves more desicn informztion than mailed ques 
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when a large sample is to be covered by the survey, even 
though a high return is seldom possible. 

The survey results are quantified and ageregated, often 
in the form of histograms from which statistics may be 
computed (HIS, page 131). These results are thenused to 
formulate policies, to specify system design (see System 
Definition Matrix, SDM, page 67), to quantify costs and 
benefits (CBA, page 212), and to evaluate programs (see 
Logical Framework, LGF, page 260). 


PROJECT FINANCIAL ANALYSIS 


The financial analysis of projects is a sequential process 
which begins by identifying costs and bencfit time strea ms 
(Cash Flow Analysis, CFA, page 177) and culminates in 
the presentation of recommendations (and assumptions) 
to decision makers (see figure 7). Many techniques sup 
port this analysis at each Stage. A survey may be necessary 
to gather financial and production data. The various im. 
pacts of a project may be tabulated across directly and in. 
directly affected groups in an impact-incidence matrix 
(IPX, page 207), This technique attempts not only to 
quantify all impacts of a project, but nonmonetary im- 
Pacts of a project using rating scales (RTS, page 29), 

The time streams of costs and benefits are discounted 
tO give their present value in order to compare project al- 
ternatives (see Discounting, DIS, page 184). The criterion 
for comparison may be net present worth (NPW, page 
188), benefit-cost ratio (BCR, page 194), internal rate of 
return (IRR, page 200), ora combination of these, 

The cash flow analysis, the evaluation criteria, and the 
impact-incidence analysis are brought together in COst- 
benefit analysis (CBA, page 212). Theendresult may take 
the form of a single go-no go decision on any one project, 
ora ranking of alternative projects for funding, 
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FIGURE 7 


rs ee 
ar IPX 


RTS 


DIS 
NP\W BCR IRR 
| 
w 
| 
CBA 


THE “CONVENTIONAL” SYSTEMS APPROACH 
Systems analysis begins with identifying objectives, 
specifying alternative means, specifying the criteria for se- 
lecting among the alternatives, and then synthesizing a 
system or plan from the choices. A sequence of techniques 
for applying the systems analysis strategy begins with Ob 
jective Trees (OBT, page 49) and/or Intent Structures 
(INS, page 55) (see figure 8). Brainstorming, Nominal 
Group Technique, or morphological analysis may be used 
to specify alternative means (see also Tree Diagrams, TRD, 
page 7+). The alternatives are analyzed using either deci- 
sion trees or contingency analysis to develop the project 
plan. Cost effective analysis, multiple criteria utilicy 
assessment, or both are used as criteria for evaluating alter- 
natives. The plan may be specified as a System Definition 
Matrix, Logical Framework, or as an operating Planning, 
Programming, and Budgeting system (PPB, page 236). 
This strategy is not altogether different from the IDEALS 
approach; however, the starting point of the latter is the 
function of the system rather than objectives for a project. 


PLANNING PROJECT ACTIVITIES FOR 
IMPLEMENTATION AND CONTROL 


Two complementary techniques which specifically ad- 
dress the scheduling of project activities are the Critical 
Path Method (CPM, page 241) and Gantt Charts (GNT, 


page 252). The techniques may be incorporated into a 
ns and facilitates the implementation of 


strategy which pla 
a project. 

Critica! path techniques 
ses essential to the achievement of project go 
nerated using techniques 
y, from a system 


begin with a list of project ac- 
tivi als (see 
figure 9). The list may be ge 


such as brainstorming or, more formall 
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specification (see Systzm Definition Matrix). From the 
critical path network, a Gantt (bar) Chart may be pre- 
pared, enabling a planner ot manager to schedule activities 
and rescurces. He may wish to present the activities and 
officers responsible in an interaction matrix (IMD, page 
92) in order to emphasize both the interrelatedness of 
tasks and the multiple staff responsibilities. A Logical 
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Framework may also be used to sharpen the identification 
of objectively identifiable indicators of progress. These 
milestones are shown as vertical lines on specific dates of 
the Gantt Chart and written on the Critical Path Method 
network at the appropriate nodes. 

Altogether, the techniques serve to ease the manager’s 
job by breaking down a complex project into finite tasks 
with planned start and end dates. Progress monitoring per- 
mits effective use of staff which is essential to successful 


project implementation. 


ANALYSIS AND PROGRAMMING OF 
DECISION PROCESSES 

A decision-making system exists for a specific purpose. 
The first step in any analysis is a function expansion to 
specify that purpose (FEX, page 45) (see figure 10), The 
aim is to specify the key decision points and the condi- 
tions which lead to particular actions, i.e., the decision- 
making policies. Two processes may be used to obtain this 
information. If the system exists, decision makers may be 
interviewed (IVW, page 23). If the task is to design a sys- 
tem, then idea generating techniques (e.¢., Brainstorming, 


ESG, page 3} are used. 
FIGURE 10 
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The results of this analysis are presented in the form of 
Saw harts ‘FLV’ page 107) oz decision tables (DTB, page 
113}. The fowzhart uses different symbols to display and 
anaiyze complex processes. The decision table presents 
he Cecision asa preprogrammed process by specifying the 
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condisions which precede—and the action which fol- 
lows—2 decision. Both techniques are usefully employed 
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the result of a strategy which incorporates intuition and 
judgments into acoherent framework (see figure 11), 
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The Delphi technique (DLP, page 168) begins by 
directing questionnaires to a selected group of prognosti- 
cators. The results of each round are summarized for the 
Delphi group, often in the form of a histogram which 
agcregates the individual judgments. Rating scales attempt 
to quantify priorities and opinions. The Delphi rounds are 
then used to produce the successive state descriptions of 
the scenario. The desired result is a clearer understanding 
of the forces and constraints which are involved in planned 


change. 


PROBLEM ANALYSIS STRATEGIES 


Problems in systems (whether ongoing Organizations or 
newly designed projects) may be analyzed by using a num- 
ber of techniques, none of which guarantees a solution. 
Rather, they promise a greater understanding of the di- 
mensions of the problem. Two techniques are central to 
the analysis of problematic behavior: Oval Diagramming 
(OVD, page 81) and Organizational Climate Analysis 
(OCA, page 40) (see figure 12). 
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Problems are first identified using a technicue such as 
Intent Structures (INS, page 55) to specify conflicting ob 
jectives and competing interest groups. The Nominal 
Group Technique (NGT, page 14) or brainstorming (BSG, 
page 3) may also be used. The problems lists may be em- 
ployed to guide the informa tion-gathering, the interview- 
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ing necessary for an analysis of organizational climate, or 
the tackling of identified problems by a Synectic prob- 
lem-solving team (SYN, page 6). The very least to be ex- 
pected from a Synectics group isa better definition of the 
problem and acreative attempt ata solution. 


One highly recommended technique for combining all 
these analyses is an ovai diagram which describes the sys 
tem or organizaticn. Most problematic behavior stems 
from poorly designed feedback of information within a 
system, and poor understanding of the far-reaching effects 
of actions. 

The analyst may ultimately wish to test the problem 
analysis by using management games (see Gaming, GAM, 
page 124) which are carefully designed to identify 


problems which arise from simulated interaction among 


system and organizational components. 


CONCLUSIONS 


This volume is acollection of techniques drawn fr-m a 
variety of disciplines and presented in a standard format in 
order to bring together various means to acommon end— 
better development prcject design. The organizing theme 


is a systems approach to project planning. The technisues 
“ore- 


are means to developing project designs which are compre 
hensive, future-oriented, and pragmatically shaped by the 
realities of power and uncertainty. While no single sech- 
niqué-is the systems engineer’s unique contribucion, all 


should contribute to better project design. 
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- Generating Ideas 


Brainstorming 
Synectics 
Morphological Analysis 
Nominal Group Technique 
Questionnaires . 

Interviews 


Tech 


niques for generating ideas and gathering information are essential for project plan- 
ning. Eliciting information from clients, 
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Two of the techniques gain their 
Brainstorming and Synectics) in contrast to 
Nominal Group Technique). 


Brainstorming 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
Brainstorming is a group creative process used to gener- 
ate z!ternative ideas and suggestions in response toa stated 
oO 


Gueston or problem. 


USES 
Brainstorming is used to: 
1: Generate many alternative solutions to a problem. 
2; Generate alternative ways of looking at a problem. 
3; Identify experts who will aid in different problem- 


% . t. 
SO:VULE pases. 


SHORT DESCRIPTION 


Prainstorming is a group process where the members, 
usally from different backgrounds, respond to a central 
cueston or theme. Emphasis is placed on generating a 
« -umber of ideas while deferring criticism and evalua- 
cainsrorming i especially useful for attacking new 
ng at old 


rosiems or for identifying new ways of lookin 
C 


ADVANTAGES 


1) Original and innovative ideas may be generated if 
premature criticism is not allowed to inhibit spontaneity. 

2) Cross-fertilization of ideas occurs, especially when 
the group is composed of experts from different fields. 

3) The relatively unstructured nature of brainstorming 
is sometimes preferred over methods like the Nominal 


Group Technique (NGT, page 14). 


LIMITATIONS 


1) Brainstorming may be unproductive if the group 
members are meeting each other for the first time during 
the session. The effectiveness of a brainstorming session is 
greatly enhanced when the members know each other be- 
fore the session and when they are motivated to solve the 


. problem under consideration (Bouchard, 1971). 


2) Superior-subordinate relationships outside the ses- 
sion may affect the free interchange of ideas within the 


session. 


3) A brainstorming session often involves misdirected 
discussion which may be unproductive and a waste of 


tume. 

4) Discussion may be dominated by one or two mem- 
bers, and may stifle the participation of other members. 
This is in contrast with Nominal Group Technique (NGT, 


page 14). 


4 / GENERATING IDEAS 


REQUIRED RESOURCES 


LEVELOF EFFORT 

For brainstorming sessions to be effective, all partici- 
pants should contribute to the discussion in order to facili- 
tate the cross-fertilization of ideas. It may require some 
effort by group members to defer their natural tendency 
to criticize or otherwise evaluate the ideas presented. 


SKILL LEVEL 

No special skills are required. Some practice may be 
necessary before brainstorming sessions are productive. 
Generally, members will bring expert skills, but they must 
be able to extrapolate beyond their own experience. The 
group leader will be more effective if he has some training 
or experience in conducting brainstorming sessions, par- 
ticularly in order to recognize when the group becomes 


misdirected. 


TIME REQUIRED 

Brainstorming sessions which last longer than an hour 
are usually unproductive. The time span is proportional to 
the number of participants. It also depends on the novelty 
of the question under consideration. 


SPECIAL REQUIREMENTS 

Blackboard and chalk, ora flip chart and marking pens, 
are used to record all suggested ideas. Writing materials for 
each member are needed. A tape recorder may be used to 


record the session. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


1) Astatement of the problem, usually in the form of a 
question, focuses Participants’ ideas, e.g., “‘How can the 
increase in Temasek’s population be stopped?” 

2) Participants may be experts, consumers, clients, or 
practitioners. Contributions, however, may be made by 
experts or creative people from unrelated fields. 


TOOL OUTPUT 


The principal result ofa brainstorming session is a large 
number of ideas which may serve as possible answers to 
the question. For example, brainstormed answers to the 
problem of slowing population increase may be: 


Educate on family planaing 

Make contraceotives free 

Shoot people regularly 

Sterilize men or women 

House men and women separately 


These answers are not qualified or evaluated. The eva!u- 
ation is done by using techniques like Decision Trees 
(DTR, page 141) or Cost-Benefit Analysis (CBA, paze 
212). Seemingly outlandish ideas are not immediazely 
rejected; they may generate more practical alternatives. 


IMPORTANT ASSUMPTIONS 


1) The brainstorming technique assumes thar the 
group process of generating ideas will be more eileczive 
than independent efforts ‘if notin total number of ideas, 
then in quality of ideas generated). 

2) It is assumed that participants will overcome their 


inhibitions and discuss ideas Eeely. 


METHOD OF USE 
GENERAL PROCEDURE 


The procedure is addressed to the person who will 
conduct the brainstorming session. 


1. Organize the group. 

1.1 Identify potential Participants, keeping in mind 
the nature of the problem. For example, if the 
problem concerns population control, potential 
Participants are a physician, a psychologist, a 
government official, a health care administrator, 
community workers, potential clients, etc. The or- 
ganizers of a brainstorming session may use the 
technique to generate the list of potential partici- 
pants for future problem-solving groups. 

Limit the group size to seven to ten. Sometimes 
larger groups are used, though they tend to de- 
crease the usefulness of the sessions. 


b2 


2. Instruct the participants. 
2.1 Explain the four guiding principles of brain- 
storming: 

a) There are no correct or incorrect ideas. Al] 
ideas are accepted on equal ground. 

b) Novel and creative ideas are encouraged regard- 
less of how foolish they may seem. Criticism is 
not allowed. 

c) Emphasis is on generating a large number of 
ideas in order to get “all around” the problem. 


d) Combinations and extensions of ideas are en- 
couraged. 

2.2 State the question or problem under consideration 
and discuss it briefly in order to clear up misunder- 
standings. Let the participants think about the 
problem for a few minutes. Indicate that they can 
make notes, but discourage any outbursts like, 
“I’ve got the solution!” : 


3. Conduct the session. 

3.1 Ask a participant to respond to the question and 
to briefly explain it. Participants may take turns, 
giving one idea at a time, or the process may be 
spontaneous. In both cases, an idea suggested by 
one member often triggers an idea from another. 
This is referred to as ‘‘leap-frogging.” Encourage 
“‘leap-frogeing” in the group, since one aim is the 
generation of a large number of ideas. However, 


the leader should exercise his judgment in keeping 


order in thie session. 


3.2 If necessary, remind members about the rules of 
brainstorming during the session. Sometimes 
members need a new direction, or they may be 
tactfully asked to curtail extraneous discussion. 
An atmosphere of cordiality and free expression 
must be maintained at al] times. The session leader 


must exercise careful judgment. 


3.3 Sometimes it is useful to present a mock problem 
to the group to familiarize members with the 
method. An exercise where members generate all 
possible uses of a machine or technique is helpful. 
A problem example might be “‘list conventional 
and unconventional uses for a bicycle.” Such an 
exercise might relax the members and make the 


main session more effective. 


3.4 Have all ideas recorded as they are generated. A 
tape recorder may be used to provide a record, but 
this method doesn’t allow for immediate reference 
to previous responses. When no more ideas are 


generated, end the session. 
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EXAMPLE 

Consider a situation where the help and authority ofa 
local government official is needed to implementa health 
care project. The problem is how to obtain the coopera- 
tion of this person in a reasonably short time. Com- 
mandeering bureaucratic support from his higher authori- 
ties can often be a lengthy and uncertain process. 

A brainstorming session is organized. Participants in- 
clude the project leader, a local person affiliated with the 
project, a troubleshooter in an election campaign, etc. 
Some brainstormed suggestions are given below. 


1) Appeal to the local official, emphasizing the impor- 
tance of the project. 

2) Bribe the local official. 

3) Bribe the higher authority (triggered from idea 2). 

4) Disregard authority and do without local help. 

5) Move to another area where the local official is 
more cooperative. 

6) Use the media to apply political pressure on the 


authorities. 
7) Convince the local elite of the importance of the 


project and work through peer pressure. 


THEORY 


One principle in the theory of creativity is that evalu- 
ating or ranking an idea stifles the generation of further 
ideas. Therefore, generation should be separated from 
evaluation. Another principle states that group processes 
may be more effective than individual efforts in generating 
ideas, largely because of cross-fertilization. See Bouchard 
(1971) and Osborn (1963) for a more detailed discussion 
of the theoretical bases of brainstorming. 


BIBLIOGRAPHY 
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Synectics 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 


Synectics is an interacting group process for generating 
creative ideas in response to a problem. 


USES 


Synectics is used to: 

1) Identify possible solutions toa given problem, 

2) Infuse novel thinking into one technology or disci- 
pline by transferring knowledge and expertise from 
another technology. 


SHORT DESCRIPTION 


A group effort is directed to problem definition and 
creative problem solving. The group discussion relies on 
two basic concepts: “making the strange familiar” and 
“making the familar strange’’ (Gordon, 1961). 

Synectics depends, first of all, on finding analogies toa 
strange or novel situation (in the problem context) in 
order to make it familiar (making the strange familiar). In 
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contrast, “making the familiar strange” means to enhance 
the possibiliry of new solutions by looking at something 
familiar froma different viewpoint. 

Different kinds of analogy are used during a Synectics 
session to draw out these ideas, €.g., comparing parallel 
situations in different fields. The group’s ideas may then 
be explored and developed into possible solutions, often 
by a technical staff member who sits in on the session. 


ADVANTAGES 


1) Solutions generated by the Synectics method may 
be quite novel and innovative. The technique draws out 
the creative expression of participants. 

2) Different analogies used in Synectics provide cre- 
ative insights into the problem. 

3) After Participating in repeated Synectics sessions, a 
trained team is available for attacking new problems. 

4) Regular participation in Synectics sessions may im- 
prove amember’s creative thin king outside of the sessions. 


LIMITATIONS 


1) Synectics requires that the members communicate 
freely and often im personate inanimate objects or abstract 
ideas. Some people may be inhibited and may not parti- 
cipate actively in the group sessions. Also, superior- 
subordinate relationships outside the sessions may limit 


discussion. If such problems are anticipated, Nominal 
Group Technique (NGT, page 14) may bea better method 
toemploy. 

2) Initial use of the Synectics method may not be pro- 
ductive. However, experience with trial problems in- 
creases the effectiveness of the method. 


REQUIRED RESOURCES 


LEVEL OF EFFORS 


A Synectics session includes eight to twelve members. 
They must mect and be organized into a group session. 
Participants must be made familiar with the technique. It 
is often possible in organizations to arrange a pool of po- 
cential members for Synectics sessions. This will minimize 
the effort required to arrange any one Synectics meeting. 


SKILL LEVEL 

A Synectics group usually includes one or two tech- 
nical experts in the problem area. Other members should 
be able to fantasize, empathize, and role play. The group 
leader needs a thorough understanding of the technique, 


as well as some training asa session leader. 


TIME REQUIRED 


Most problems require only one session lasting at most 
four hours. The novelty of the problem situation and the 
variety in the background of the members affect the 
lencth of the session. Progress is also affected if group 
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members are inexperienced or overly inhibited. 


DESCRIPTION OF TOOL 


DEFINITIONS aa 

1) Personal analogy is used in Synectics sessions where 
2 soup member identifies with an element of the problem 
z-d looks at it as though he were that element. For ex- 
emple, if the problem is to develop inexpensive ways to 
cry and store grain in a wet climate, a member identifies 
aith a sngle grain in a storage bin. 

2) Direct anzlogy compares the problem being f 
roa parallel sjcuetion in another field, technology, or dis- 
e. For example, the grain storage problem may be 
agation is to be 


aced 


sie lir 
compared toa bacterial colony whose prop 
trovied against disrurbances in moisture and airflow. 

m by cbjec- 
to identify 


3: Symbolic analogy describes the proble 


eye and im personal titles. These titles are used 
aroblems which may be described by the same title. 


Sreey ay 
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They are generaily expressed in two words, usually de- 
scribing two conflicting attributes of the problem. For ex- 
ample, the grain storage problem may use “Crowded Sepa- 
ration” to describe the facets of the problem—that of 
packed storage and that of sufficient grain separation to 
allow for airflow. 

4) Fantasy analogy is the participant's wishful thin k- 
ing that the problem may solve itself or cease to exist. For 
example, in the grain storage problem, one fantasy an- 
alogy may be that “Grains do not germinate, even if stored 
moist.” This leads to the idea of irradiating the grain in 


order to cease germination. 


REQUIRED INPUTS 

1) A statement of the problem is necessary. For ex- 
ample, “Grains must be dried and stored economically ina 
poor region where the climate is wet.” 

2) Participants in a Synectics session are experts con- 
cerned with the problem, along with six to eight other 
members preferably from a variety of disciplines. 


TOOL OUTPUT 

1) A restatement of the problem definition can be ex- 
pected. In the grain storage problem, the restatement may 
be, ‘“‘It is required to store grain so that it does not spoil.” 

2) A Synectics session results in a number of possible 
problem,e.g., ‘Grradiate grain and store in 
any ordinary place,” “‘store with bags of chemicals that 
absorb moisture,” or ‘plant crop so that the harvest isina 
dry season.” The merits of each solution may then be 


evaluated for feasibility. 


solutions to the 


IMPORTANT ASSUMPTIONS 

People vary greatly in their ability to utilize analogies, 
and consequently, their contribution to a Synectics group 
will differ markedly. The assumption behind Synectics is 
that cross-fertilization of ideas will lead to innovation and 


creative responses. 


METHOD OF USE 


GENERAL PROCEDURE 


A Synectics session has basically two phases. The first 


phase is to introduce the problem to the group and obtain 


a redefinition of the problem. The second phase utilizes 


four analogy methods to generate possible solutions. It is 
sometimes necessary to identify new and related probiems 


that must be solved before the original problem solution 


can be attempte d. 


8 / GENERATING IDEAS 
The following is a guide for the Synectics leader. 


1. Define the problem. 
Present the problem to the group. Have a technical 


expert or the dedsion maker briefly explain and 


analyze the problem. 


2. Purge ideas and criticisms. 

2.1 Ask that the members suggest any solutions or 
ideas immediately after the presentation of the 
problem. 

2.2 Have the experts discuss the feasibility and suit- 
ability of these ideas as they are suggested. This 
gives participants a better and deeper under- 
standing of the problem. 


fe Wetcste it:< problem, 

3.1 Ask the participants to propose restatements of 
the problem. 

3.2 Select one definition that seems most accept- 


able to participants. 


4+. Use direct analogies. 
4.1 Ask evocative questions to generate a number 


of direct analogies by drawing from similar 
problems in other fields. 
4.2 Choose one analogy for further exploration. 


5. Use personal analogies. 

5.1 Request some members of the group to play the 
roles of some elements of the problem. The ele- 
ments may be animate or inanimate. For exam- 
ple, participants might be asked to be trees and 
examine the problem of preventing forest fires. 
Ideas and feelings expressed by Participants 
may trigger solutions to the problem, 

It may be necessary to ask questions of partici- 
pants to generate further insight into the prob- 


5.2 


lem. 


6. Use symbolic analogies. 

6.1 Ask participants to generate symbolic titles for 
the problem. Such titles should be expressed in 
two words, usually describing two conflicting 
attributes of the problem. 

6.2 Select one analogy and have members explore 
it. 


7. Use fantasy analogies. 
7.1 Suggest some physical or theoretical im possi- 
bilities related to the problem that may elimi- 

nate or simplify the problem. 


7.2 


Let participants suggest other fantasy anacgizs, 
These ideas often generate possible solzcions. 


8. Force fitsome analogies. 


8.1 


8.2 


ae 


If the analogies do not directly aid in solving the 
original problem then “force fit” an analozy. 

State some aspect of the problem and then 
apply it directly to the analogy to provide 
greater insight into the constraints and circum- 
stances of the problem situation. For example, 
Stored grain germinates if it gets wet. What 
would happen to a bacteria culture (force Ar <0 


direct analogy)? 


9. Repeat necessary steps. 


9.1 


9.2 


Generate analogies (steps 4-7) in any conveni- 
ent order. It may be necessarv to use one cr 
more of these analogies during the discussion. 
Direct the group into using these analogies in 
combination or to help the members force fir 


an analozy. 


10. Redefine the problem or present the solutions. 


10.1 


10.2 


Determine if the results of the session are sais 
factory. If not, it may be necessary to go back 
to step 3 and redefine the problem. Sometimes 
other related problems may be identified which 
should first be solved. 

Present the summarized results to the group and 
call the session to anend. 


EXAMPLE 


The following example gives some excerpts from the 
discussion in a Synectics session. The steps are identified 
in parentheses. 


LEADER: 


PETER: 


EXPERT: 


LEADER: 


PETER: 


We want to develop ranking or rating procedures for 
Uliterate or semi-litcrate decision making or client 
groups (Problem as Given). The leaders of these 
groups would be literate. The group is to choose be- 
tween different alternatives. As an exam ple,azroup 
might choose between different modes of healzh 
care delivery. 

Have the leader explain alternatives orally to the 
group and associate a symbol with each alternative. 
Let the group order the symbols to show their 
choices (Purge). 

But the members may not be able to retain the asso- 
clations (Criticism of Ideas during Purge). 

Pat, if you were illiterate and if Peter’s method were 
adopted, what would you do? (Personal Analogy) 
Peter, why don't you demonstrate the method. 

I've given symbols to each of the alternatives, Par. 
Now choose the symbol which indicates your choice 
of alternatives. 
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PAT: 
PETER: 


EXPERT: 


LEADER: 


RAJA: 
PAT: 


PETER: 


LEADER: 


LEADER: 


JUZAR: 


PETER: 


JUZAR: 


I am confused. I don’t remember the symbol for one 

of the alternatives (Personal Analogy). 

We could try choosing betwcen two symbols at a 

time. 

There is a problem though. Someone might choose B 

before A, C before B, C before A! The preferences 

are not transitive. 

Okay, let’s consider another situation. There isa pet, 

say a cat. You want to communicate to it that it can 

choose only one kind of pet food (Direct Analogy). 

Make the cat taste a little from each container and 
find out which it prefers. 

What if there are six types of pet food. It may have 
forgotten how the first type tasted. 

Also there is the problem that the cat might be in- 
fluenced by the order in which it is given the food. 
Hence the order that the alternatives are presented 
might be im portant. 

Okay, here we have a group of people who have to 
choose a health care plan. They look up to the 
leader. They want to please him, and they know he 
will only let them choose one plan. At the same time, 
they would like any or all of them. 

You mean the cat is hungry and would like all of the 
different foods. 

You have a situation where there are many alter- 
natives and the group would like to have all of them 
(Force fitting analogy from cat wanting all different 
foods). But the choices are limited, and only one can 
be selected. 

How about the phrase “‘Plenriful restrictions” to de- 
scribe this? (Syrabolic Analogy) 

I think 1 would like the phrase “Eagerness— 
Obedience.” You see, the cat is eager to eat it all but 
looks up to the owner. In the same way, the mem- 
bers respect the leader. 
The problem might be that the members will under- 
stand the alternatives and know what they want. It is 


only needed to communicate that they have to make 


a choice. 
They ma 
true. 


y not want to make a choice. Often this is 
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PAT: Quite true. They may not wish to make any choice. 
They may not like any, but do not wish to say so. 

Why does the leader want the members to choose? I 
want to fantasize that there is no problem. So there 
is no group meeting. rhe leader simply makes the 
choice (Fantasy Analogy). 
Let us try posing the problem this way. The leader 
t wants the members to rubberstamp his 


RAJA: 


LEADER: 
jus 
choice.... 

Okay, this is what we concluded. The problem is not 
that of developing a rating procedure, but one of 
how to communicate that choice is actually being 
made by the members. So related questions of mo- 
tive behind the meetings need to be resolved. For ex- 
- ample, are members voting merely to rubberstamp 
the leader’s choice? Are they there to make a demo- 
ision? Does the leader hope that letting 
ementation of 


LEADER: 


cratic dec 
members vote will mean easier impl 


the plan, etc.? 


The result of this exercise was not a problem solution 
but a redefinition of the problem which brought to light 


various constraints on the rating system procedure (sec 


also Rating Scales, RTS, page Zo). 


THEORY 


Gordon (1961) gives a theoretical basis showing how 


the use of analogies stimulates creativity. 


BIBLIOGRAPHY 


Davis, J. A., and Scott, J. A. Training Creative Thinking. 
New York: Holt, Rinehart and Winston, 1971, pp. 


143-61. 


Gordon, W. J.J. Synectics. New York: Harper and Row, 
1941. 


Morphological Analysis 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


Morphological analysis generates a large number of 
element combinations for further examination. 


USES 
Morphological analysis can be used to: 
1) Analyzea problem systematically. 
2) Develop alternative projects and programs. 
3) Identify a number of possible future states in a 


problem situation. 


KEY DEFINITIONS 
1) An element is a part of a problem description, e.g., 
population, land use, and climate may be some of the 


elements in an agricultural policy program. 
2) An attribute of a system includes the elements or 


components of the system and their relationships. 


SHORT DESCRIPTION 


Morphological analysis involves decomposing a prob- 


lem into its elements, identifying a number of alternative 


attributes for each element, and synthesizing alternative 
solutions by combining the attributes in different ways. 
The attributes are written in the form of a matrix to sim- 
plify the process (see figure 1). The elements may descrike 
a future environment, in which case the combinations will 
be different futures. 


ADVANTAGES 


1) A large number of possible solutions are generated, 

2) The method’s exhaustive nature decreases the likeli- 
hood of overlooking possible solutions. It often identifies 
solutions that may have been overlooked if other 
methods, such as Nominal Group Technique (NGT, page 
14), were used, 

3) Because the Process of synthesizing alternative solu- 
tions in morphological analysis is systematic, the biases 
and prejudices held by the person using the tool are 
avoided while generating ideas. 


LIMITATIONS 


1) Large problems lead toa large number of elements 
and attributes. In such cases, morphological analysis leads 
fo so many possible solutions that evaluation becomes un- 
wieldy. 

2) WF any significant element in a problem is over- 
looked, the morphological analysis suffers accordingly. 
This is the major limitation of the technique: it does not 
ensure that all elements are specified. The systems defini- 
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FIGURE 1 


Attributes for an Energy Policy Situation 


ELEMENTS 


Gas 


Primary 
Source 
of Energy 


Industrial 


Household 


tion matrix (SDM, page 67, or Tree Diagrams, I RD, page 
74) may be useful in this regard. 


REQUIRED RESOURCES 


SKILL LEVEL 


Knowledge relating to the pro 
decompose the problem into its e 
use this approach effectively. The analyst requires the 
ally interesting combinations. 


blem area and the skill to 


lements are essential to 


zbiliry to recognize potenti 


~~ 


TIME REQUIRED 

The rime required depends on the complexity of the 
problem and the number of elements identified. A simple 
d less than a day. The time required in- 


problem may nee 
Yerments are identified. 


creases Very rapidly asmoree 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


A statement of the problem is 
EY situation 1n Temasek” 


necessary, such as “Give 


ssible descriptions of the ener 
P e progam needs to be de- 


cimary health car 


Energy Low High | 

Demand Demand Demand 
Growth Zero Slow — 
Rate ‘ Growth Increase 


TOOL OUTPUT 


Morphological analysis results in a number of alterna- 
statement synthesized from 


different elements 


Rapid 


Increase ~ 


Transportation 


tive solutions to the problem 
combinations of attributes for the 
identified as part of the problem situation. For example, a 
table with six elements and four attributes can have (4)° = 
4096 possible combinations. However, many of these 
combinations may be physically if not theoretically im- 
possible or meaningless. The remaining feasible combina- 
tions represent the product of a mor phological analysis. 
However, even illogical combinations may trigger feasible 


alternative solutions. 


IMPORTANT ASSUMPTIONS 


A problem or task is divisible into discrete elements, 


each of which has one or more alternative attributes. This 
he analysts may always 


:s not a limiting assumption since t 
hat decomposition is 


define a problem in such a way ¢ 


feasible. 


METHOD OF USE 
GENERAL PROCEDURE 


1. Identify elements and their attributes. 
1.1 Consider the problem as stated and think of the 
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elements that are part of the problem situation. 
Many elements can be identified directly from the 
protlem statement. For example, elements like 
“type of cattle,” “method of raising,’ and 
“scale of industry” follow directly from ‘‘it is 
required to develop a meat packing industry.” 
Each of these elements may be described by 
different attributes. 

Generate as many attributes as possible. An at- 
tribute often comes to mind before the element. 
For example, the attribute ‘‘government subsidy” 
may lead to the element “source of revenue.” 
Other attributes for the element are then identi- 
fied, e.g., ‘‘private donations” or “lottery tickets.” 


2. Develop the table of attributes. 


" cclementsandattribures inta a tahular 
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2 s 3 
torm (see rigure 1). 

-2 List one element per row with its attributes. The 
table will have as many rows as there are elements 
identified. Often, the process of filling in the table 


will suggest new elements or attributes. Include 
them in the table.- 


tw 


3. Synthesize alternatives. 


3.1 Select one attribute from each element row (see 


dashed line, figure 2). 


Combine the attribuzes to describe a particuiar al- 


3.2 
ternative. 
3.3 Throw out combinations which are unfeasis!e cr 
illogical. 
3.4 Examine the remaining combinations fer possible 
problem solutions or feasible alternatives. 
EXAMPLE 


In order to develop an energy policy, agovernment de- 
cides to use contingency analysis (CGA, page 147). A 


a 
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number of possible future states need to be idenzif 

Morphological analysis was used as follows: 
Some of the elements are discovered immediately, e.z., 
“energy demand’’and “source of energy.” Other elemenss 
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1) A situation of high energy demand with a rapid eco- 
nomic growth; the largest source of energy is oil used pri- 
marily in transportation (shown in figure 2). 

2) A zero growth economy with low enerzy demand 
using solar energy primarily for household consumption. 
Eighty-eight other combinations were possible, though 
only a few were used in the contingency analy'sis. 


FIGURE 2 
One Combination of Attributes Indicated in a Morphological Chart 
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THEORY 


Morphological analysis was developed by Zwicky 
(1969) and used extensively in a variety of contexts rang- 
ing from new product development to problem solving. 
Wissema (1976) reports an interesting application of the 
technique in technological forecasting, particularly em- 
phasizing that morphological analysis could be used to 


construct scenarios (SCN, page 164) and Delphi quéstion- | 


naires (DLP, page 168). 
Kaufman (1968) deals with the problem of ranking the 
combinations of attributes to facilitate the selection of 


feasible alternatives. He explores the implications for deci- 


The parallel between the mor phological box 


sion theory. 
interaction matrix dia- 


representation of a problem and 
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grams should be clear from examining the format of the 
products of each technique (see IMD, page 92). 
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Kaufman, Arnold. The Science of De 
York: World University Library, 
page 234-41. 

Wissema, Johan,G. “Morphological Analy sis: Its Applica- 
tion to a Company Technological Forecasting Investi- 

. pation.” Futures (April 1976): 146-53. 

Zwicky, Fritz. Discovery, Invention, Research TI 

the Morphological Approach. Toronto, Canada: Mac- 


millan, 1969. 


cision-Making. New 
McGraw-Hill, 1968, 


1rough 


Nominal Group Technique 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 


The Nominal Group Technique (NGT) is a group pro- 
cess for eliciting opinions and aggregating judgments to 
increase rationality and creativity when faced with an 


unstructured problem situation. 


USES 


NGT may be used to: 

1) Identify the elements of a problem, especially 
where there are political, social, and cultural elements. 

2) Identify and rank goals or priorities, 

3) Identify experts whose experiences or skills may be 
useful in other decision-making techniques. 

4) Involve personnel at all levels in the decision- 
making process in order to promote the acceptability of 
the final decision. 


KEY DEFINITIONS 


1) A nommal group is a group process in which the 
members work independently but in each other's pre- 
sence. 


2) An interacting group permits discussion berween 
participants (¢.2., Brainstorming, BSG, page 3, is an inter- 
acting group process}. 

3) Rank-ordering is the process of weighing one item 
against others and then ordering the items by weight ona 
scale such as importance or priority. 


SHORT DESCRIPTION 


The Nominal Group Technique is a structured process 
which taps the experiences, skills, or feelings of partici- 
pants. A question is posed to the group. Each member 
writes down as many responses as possible. The group 
leader asks each member in turn to state an idea from his 
or her list and writes it on a flip chart placed before the 
group. No discussion is permitted until all ideas have 
been listed. Each item is then briefly discussed in an 
interacting group format. The Participants indicate their 
preference for important items by rank-ordering, a 
process which may be repeated with intervening discus- 
sion and argument. 

The outcome of the process is the mathematical 
aggregation of each member’s preferences to give the 
group’s ranking of responses to the question. 


ADVANTAGES 


1) Dominance by high-status, aggressive, or articulate 
members is reduced since each has an equal opportunity 


to Participate. 


2) The group remains problem-conscious; and prema- 
ture evaluation, criticism, or focusing on ideas is 
avoided. 


3) The silent generation of ideas minimizes the 
interruptions in each person’s thought processes. 

4) A written record increases the group’s ability to 
deal with a large number of ideas. It also avoids the loss 
of ideas. 

5) Discussion only to clarify items helps eliminate 
misunderstanding, without reducing the group’s effici- 
ency. 

6} Some studies have shown that, compared to 
interacting group processes, €.g., Brainstorming (BSG, 
page 3), the Nominal Group Technique (NGT) enhances 
the conditions for creativity when generating information 
on a problem. It avoids rambling discourse and other de- 


ficiencies found in group processes. 


LIMITATIONS 

1) Cross-fertilization of ideas is diminished due to 
the structure imposed by the NGT. 

2) The NGT may reduce flexibility, e.g., some group 
members may feel that the purpose of the meeting or 
the question posed is irrelevant or misleading, but they 


have no opportunity to change it. 
3) Bringing group members together may be cost- 


prohibinve. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

Some administrative effort is required to determine 
the purpose of the meeting and to structure the 
proposed question. Potential group members need to be 
idencified, notified, and assembled. << 


SKILL LEVEL 

The leader of the nominal group should not bias the 
= O2p toward his view; yet he must control unwanted 
xO-p Lehavior without alienating people. 


TIME REQUIRED 

In a study quoted by Delbecq, et al. (1975), the total 
-Amizistrative man-hours to prepare, conduct, and fol- 
low tarough for one g-cup recuired an average of 4.4 
Lours for NGT, 4.2 hours for interacting processes, and 
> 1 hours for the Delghi process (DLP, page 168). 
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SPECIAL REQUIREMENTS 

A flip chart and marking pens are needed for each 
group. Index cards (or similar small cards), approximately 
six per participant, facilitate the voting process. 

The seating arrangement must allow all members to 
easily focus on the ideas listed on the flip chart. Some 
means of displaying the completed chart pages is 
necessary (e.g., tacks or masking tape to afix them to the 


walls). 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITION 


Round-robin is a process for serially recording ideas 
where each participant provides an idea in turn. No 


discussion occurs, although the leader may ask for a 


show of hands on how many participants had a similar 
idea. (This is noted next to the item on the list.) Those 
responding then eliminate that idea from their respective 
lists. The process may continue in a circular fashion until 


all participants’ lists are exhausted. 


REQUIRED INPUTS 


The nominal group generally includes five t 
members. Less than five members may not allow for the 
quality and diversity of opinions required. Large groups 
produce more interpersonal differences, which lengthens 
the process without a substantial increase in the quality 
of output. If more than ten persons must participate, it 
is better to divide the group for the round-robin and 
combine them for final discussion and voting. 

The group leader may be directly involved in gener- 
ating and discussing ideas. The composition of the group 
may be homogeneous or heterogeneous. Studies have 
shown that heterogeneous groups exhibit more creativity 


(Delbecq, 1975). But interpersonal differences and 
crease for such groups. 


o nine 


communication problems may in 

The NGT question provides the basis for generating 
the ideas. It should be worded to prevent misunder- 
standing and should be stated as objectively as possible. 


TOOL OUTPUT 

The NGT produces a list of ideas and a rank-ordering 
of their importance. The group leader may wish to 
combine overlapping ideas under a common heading. 


METHOD OF USE 


GENERAL PROCEDURE 


The general procedure for the Nominal Group Tech- 


nique is straightforward. But because it runs counter to 
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the experience of most people in leading groups or 
participating in committee work, the steps must be 
followed closely. Wich this in mind, the guidelines 
prescribed by the originators of the Nominal Group 
Technique have been reproduced below (Delbecq, et al., 
1975, figure 3-7, page 67-69): * 


1. Silent generation of ideas in writing. 
Present the nominal question to the group in 


1.1 
writing. 

1.2 Verbally read the question. 

1.3 Ilustrate level of abstraction and scope desired 
with example which does not distort (lead) 
group responses. 

1.4 Avoid other requests for clarification. 

1.5 Charge the group to write ideas in brief phrases 
Cr et Sse 

1.6 Ask group members to work silently and 
independently. 

1.7 Model good group behavior. 

1.8 Sanction disruption of the sulent, independent 
activity by comments addressed to group as a 
whole. 

Benefits: 


1) Provides adequate time for thinking. 

2) Facilitates hard work by the model of other group 
members reflecting and writing. 

3) Avoids interruption of each other’s thinking. 

4+) Avoids premature focusing on single ideas. 

5) Eliminates dominance by high-status or aggressive 
members in idea generation. 

6) Keeps the group problem-~entered. 


2. Round-robin recording of ideas ona flip pad. 

2.1 Indicate objective of the step is to map the 
group’s thinking. 

2.2 Explain need to present ideas in brief words or 
phrases. 

2.3 Explain process of taking one idea serially from 
each member. 

2.4 Explain group members must decide if items 
are duplicates. 

2.5 Explain that an individual may “pass” when he 
has no further items, but may “re-enter” later, 

2.6 Express the desirability of hitchhiking and 
adding new ideas even if they are not on 
individual nominal worksheets. 

2.7 Explain inappropriateness of discussion Prior to 
completion of listing. 


“From Croup Techniques for Program Planning by André L. 
Delbecy, Andrew Van de Ven and David H. Gustafson, Copyright 
(c) 1975 by Scott, Foresman and Company, Reprinted by per- 


Mission, 


Vigne Boeri: 
a” « ta gh f * J 
rg rear, 


Record ideas as rapidly as possible. 


2.8 

2.9 Record ideas in the words used by goxs 
members. 

2.10 Provide assistance in abbreviating only in spe- 
cial situations. 

2.11 Make the entire list visible by tearicz cif 
completed sheets and taping them on an area 
visible to all group members. 

2.12 Sanction group asa whole if individuals engaze in 
side conversations or attempt to discuss items 
prior tocompleting the listing. 

Benefits: 


1) Equalizes opportunity to present ideas. 
2)" Assists in separating ideas from personalities. 
3) Provides a written record and guide: 
a) Ancreapes secre’ shilign 2m don} aceh + Ie cage 
numoer of ideas. 
b) Avoids loss of ideas. 
c) Confronts the group with an array of clues. 
d) Encourages hitchhiking. 
4) Places conflicting ideas comfortably in fronr of 


group. 
5) Forces the group to fully explore the problem. 


3. Serial discussion for clarification. - 
3.1 Verbally define the purpose of the step: 
a) To clarify the meaning of items. 
b) To explain reasons for agreement cr dis- 
agreement. 


3.2 Indicate that final judgments will be expressed 
by voting, so arguments are unnecessary. 

3.3. Pace the group so that all ideas receive su fiici- 
ent time for clarification. 

3.4 Avoid forcing the member who originally lists 
the idea to be solely responsible for clarifying 
the item. 

Benefits: 


1) Avoids having discussion focus unduly on any 
particular idea or subset of ideas. 
2) Helps eliminate misunderstanding, 
3) Provides Opportunity to express the logic behind 
items. 
_ 4). Allows members to disagree without argumenta- 
qon, 


4. Preliminary vote on item importance. 


4.1 Ask the group to select from the entire list a 
specific number (7 + 2) of priority (important) 
items, * 


"Five to nine items are al! that can be effectively ranked on one 
dimension of discrimination (see Rating Scales, RTS, page 29), 


ee a 


FIGURE 1 
Index Card Ilustrating 
Rank-Order Voting Process 


Number 
from 
original 
group 
lis Brief description 
t ‘ 
of item #15 


Number indicating 
rank-order 


4.2 Place each priority item on a separate 3 x 5 
card or rating form [see figure 1}. 

4.3. Rank-order or rate the selected priority items. 

4.4. Collect the cards or rating forms and shuffle 
them to retain anonymity. 

4.5 Tally the vote and record the results on the flip 
chart in front of the group. 


Benefits: 

1) Obtaining independent judgments in writing helps 
eliminate social pressures. 

2) Expressing judgments mathematically by rank- 
ordering or rating increases accuracy of judgments. 

3) Displaying the array of individual votes clearly high- 


lizhts areas needing further clarification or discussion. 


5. Discussion of the preliminary vote. 
5.1 Define the role of the step as clarification, not 
pressure toward artificial consensus. 
5.2 K-ep the discussion brief. 
5.3. Caution group members to think carefully about 


any changes they make in their voting. 


Benefits: 

1) Provides group members a final opportunity to 
clarify their positions. 

2\ Ensures that “spread” votes really reflected dif- 
gment, not unequal information or mis- 


fr 


erences in juc 
understanding. 


6. Final vote. 
6.1 Repeat step 4. 


6.2 Clozzre to the meeting. 


Benefits: 


Accurate aggregation of group judgments and error re- 


NOMINAL GROUP TECHNIQUE / 17 


EXAMPLE 


The steps of the Nominal Group Technique have been 
presented in a straightforward procedure which reflects a 
structured group process. The following example high- 
lights some of the key points in this process and illustrates 
typical intermediate products generated by the tech- 
nique.* 

The Ministry of Health for the government of Temasek 
wanted to analyze the state of the health delivery service. 
The evaluation staff elected to use the Nominal Group 
Technique and brought together a diverse group of physi- 
cians, rural health technicians, public health personnel, 
field personnel, and a cross-section of clients (from dif- 


ferent income and social classes). 


Silent Generation of Ideas in Writing 

The assembled participants were broken into groups of 
nine by randomly selecting participants representing rele- 
vant occupations. 

After the opening welcome and a brief explanation of 
the Nominal Group Technique and the objectives for the 
afternoon, each participant was given a single sheet headed 
with the following question: 

WHAT ARE THE BARRIERS TO RECEIVING 
ADEQUATE HEALTH CARE INOURCOUNTRY? 


The participants were allowed 15 minutes to list re- 


sponses from their own viewpoints. 


Recording of Ideas on a Flip Pad 

The leader for each group (a member of the evaluation 
staff trained in NGT) acted as the recorder to serially list 
the ideas. Some of the ideas generated by one group in- 
cluded: 

1) Nomoney to pay for services 

2) Lack of adequate facilities 

3) Too many doctors in the cities 

4) Not enough trained personnel 

5) Over reliance on traditional remedies 

6) Not enough doctors 
Note that this list contains some contradictions. The 
leader deferred discussion until the next step. However, 
when jtem 6 was voiced, someone asked whether this was 
the same as item 4 since doctors are included in trained 
personnel. The leader asked the participant if he thought 
item 6 should be dropped. The reply was negative, and the 
round-robin recording continued. All of the groups 


generated 15 or more items. 


‘This example is adapted from an exercise conducted by one of 
the authors ata workshop to cnable county health agencies to pian 


for the treatment of alcoholics. 
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Serial Discussion for Clarification 
During the discussion of each item, the participants 
clanfied their responses, e.g., since trained personnel can 
replace many functions of the physician, items 4 and 6 
deserved separate consideration. Item 5 included going to 
a traditional village healer instead of the nearest clinic. 


Preliminary Vote on Item Importance 
Each participant was asked to rank (from the list) the 
five most significant barriers to receiving adequate health 
care. The tally of the vote was recorded on the flip chart, 
using the numbers from the items. A vote of five meant 
that the Participant viewed that item as the most signifi- 
cant barrier. The votes for the first six items were: 


Item Number Votes Total 
1) 4,1 5 
2) 5,4 9 
3) 22,4 8 
4) 3) 5,3 11 
5) 1 1 
6) 3, 5 8 


Discussion and Final Vote 

During the discussion following the first vote, the parti- 
cipant who had presented item 5 expressed his amazement 
that the other members had not found the interference of 
superstitions and traditional healers to be a barrier. Other 
Participants were not swayed by his arguments, and the 
final vote on the item was unchanged. Totaling the indi- 
vidual rankings for each of the above items gave item 4 the 
most weight (11) followed by item 2 (9) and item 6 (8). 
Note that this example is incomplete since the rest of the 
list has not been presented, but the essential idea remains 
the same. A group with rather large status differences was 
able to use the Nominal Group Technique to identify and 
rank problems in receiving health care. 


THEORY 


The Nominal Group Technique is the resu!r of analysis 
effective 


and experimentation with group processes for ef: 
planning and decision making, and is credited to Van de 
Ven and Delbecq (Delbecq, et al., 1975). The creativity of 
a group is an important determinant of its success. Tyzes 
of group processes and leadership techniques for allcwing 
creativity have been discussed widely (Maier, 1970: 
Osborn, 1957; Collins and Guetzkow, 1964). 

The Nominal Group Technique utilizes the mathemad- 
cal ageregation of group judgments to come to a group de- 
cision. The theory is discussed by Huber and Deibecg 
(1972). The advantages over conventional means for com- 
ing to a group decision (e.g., Consensus cr majority rate) 
are described by Delbecgq, etal. (1975). 
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Questionnaires 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
Questionnaies generate ideas, Opinions, or informa- 
tion from aselected target population. 


USES 

Questionnaires are used to: 

1) Structure the content of an interview ( 
IVW, page 23). 

2) Obtain responses for a sam 
SVY, page 36). 

3) Provide the format for communicating with Delphi 
participants (Delphi, DLP, page 168). 


Interviews, 


ple survey (Surveys, 


KEY DEFINITIONS 

1) Open questions permit the respondent to answer as 
he or she chooses. 

2) Closed questions recul 
responses to prespecified categories, ¢ 
A,B. 
3) Frequency distributions. or histo 
frequency of different cazegories of response 


ae 


grams, HIS, page 131). 


e the respondent to limit 
g., Yes/No, Option 


gtams, plot the 
(see Histo- 


SHORT DESCRIPTION 

Questionnaire design is an art with scientific elements 
determined by the purpose of the questionnaire, the type 
of responses desired, the characteristics of the respondent, 
and the method of distribution. Questionnaires may be 
distributed by mail, by phone, or directly. The responses 
may be obtained from a direct interview or by a self- 
administered questionnaire which is then collected (e.g., 
by return mail). The length and format of the question- 
naire are crucial factors affecting the return rate, the 
validity of responses, and unintentional biases or distor- 


tion. 


ADVANTAGES 
1) Self-administered questionnaires allow the partici- 


pant time to ponder the questions. 
2) Mailed questionnaires may be distributed to a popu- 


lation at less cost than interviews. 
3) Phone questionnaires involve minimum cost and 


maximum speed of response. 
4) The anonymity of the respondents may be ensured. 


LIMITATIONS 
1) The return rate for mailed questionnaires is usually 


very low. 
2) Those who do return the questionnaire may sharea 


common interest that biases the sample. 
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3) Distribution by mail is often im pract*cal because of 
celiability and time constraints. 

4) Self-administered questionnaires are rigid and in- 
flexible—confusion and ambiguities cannot be clarified by 


an interviewer. 
5) Self-administered questionnaires can’t be employed 


for illiterate or semi-literate populations, and may lead to 
erroneous responses for literate but mixed-culture target 


gtoups. 


REQUIRED RESOURCES 


LEVEL OFEFFORT 

Ry far the orearest effort must go into designing and 
testi the Corniat of the yuestiouiiaire. Other tasks, such 
as distribution and analysis, are Proportional to the 
number of respondents, the number of open-ended ques- 


tions, andthe length of the questionnaire, 


SKILLLEVEL 
Questionnaire design requires skills which are only 
gained by experience. It is im possible to anticipate the 
misinterpretations and personal logic in responses; there- 
fore, pretesting the questionnaire is important to success. 


TIME REQUIRED | 

A comprehensive questionnaire desizn might take 
several days. Time must be allowed for pretesting, dis- 
tributing the questionnaires (or interviewing), and an- 
alyzing results. Allowing time to encourage returns of 
mailed questionnaires is essential if the return rate is to be 


reasonably high, 


SPECIAL REQUIREMENTS 


The necessity to duplicate and assemble the question- 
naire copies must not be ignored. Manual analysis of re- 
sponses can be tedious, and electronic computation equip- 
ment (including specially Programmed digital com puters) 
is a great relief. Where such means are cost-effective, the 
response format should be designed with computer coding 
in mind. 


DESCRIPTION OF TOOL 
REQUIRED INPUTS 


Questionnaire design begins with the Purpose and 
farget population clearly identified (see Surveys, SVY, 


page 36). 


Pr nae mee me ane 


Mail facilizies and self-addressed stamped envelcpes are 
essential for mailed questionnaires. Include a cove- 
describing the purpose and derails of the GL estionnaire, 
even if the tarzer population has been previcusly in- 
formed. For example, Delphi Participants are involveding 
series of questionaaires which are retumed in a WOW ay 
communication (see Deiphi, DLP, page 168}, 


TOOL OUTPUT 

Individual questionnaires are not the end preducr cf 
questionnaire design—the agetegated responses of the 
Participants is desired. Consequently, an incomolete cr 
mutilated questionnaire that is returned is valid informa- 
tion for the analvsr, 

Decision make.s Somuad iiloimiacion ia alt Casuy Gr. 
gested form. This includes summaries of typical resconses 
as well as indications of the pattern of responses, €.2.2 
graph of the frequency of categorical responses (342 Histos 
grams, HIS, page 131). 

Usually the questionnaire results will be an inzer. 
mediate product in further analysis which may or may not 
be transmitted to decision makers. But most of the cme ir 
will be appended to a final report (see Surveys, SVY, page 
36, and Delphi, DLP, page 168). 


IMPORTANT ASSUMPTIONS 


A questionnaire is a measuring instrument. It is a trans- 
mitter of information from a selected individual to an an- 
alyst. The responses must be accepted at face value in the 
absence of any other information. Therefore, the analyst 
assumes that responses were given by the selected indi- 
vidual, that the responses were freely given, that the re- 
spondent was not just trying to please him, etc. Some of 
these necessary assumptions may be validated by ran- 
domly spot-checking returned questionnaires, e.g., by di- 
rect interview or phone. 


METHOD OF USE 
GENERAL PROCEDURE 


1. Specify the purpose of the questionnaire. 
1.1 Identify the topics to be covered—keep the num- 
ber toa minimum. 
1.2 Identify the target population and any special cul- 
tural or educational characteristics it might have, 


1.3 Determine the means of distribution and collec- 
tion of the questionnaire. 
1.4 Specify an acceptable return rate and adjust the 


sample number of questionnaires accordingly. A 


return rate for mailed questionnaires may be any- 
where from 15% to 90%, depending on the motiva- 
tion of the respondents and the topics selected. 


2. Design the questionnaire (Phillips, 1966). 

21 Start with basic information about the respon- 
dent; consider only that information essential for 
analyzing the results. Ensure anonymity if desired. 
On any topic, begin with general questions. Then 
get more specific. 

Arrange the questions logically and avoid abrupt 
transitions. 

Examine the order for questions which may exert 
an undesired influence on the response to subse- 
quent questions, e.g., a question which is likely to 
antagonize the respondent should be placed near 
the end of the questionnaire. 

If necessary, code the questionnaire so that re- 
sponses and participants may be correlated, e-g., 
arrange questions in different sequences. 


2.5 


Edit each question after completing the list. 


3.1 Avoid long questions. 
3.2 Eliminate ambiguities and double entendres by in- 


corporating examples or by setting the question in 
context. 
Determine if an open-ended question can be re- 


& 
lw 


written as a closed question. 

Make certain that the categories of response for 
closed questions are sufficiently comprehensive, 
e.g., by including a ‘‘none of the above’ category. 
Eliminate emotionally charged words and leading 
o: loaded questions. 


i» 
4a 


. Design validating questions into the survey. 

4.1 Repeat the same question (rephrased) 
point in the questionnaire. 

ude collaborating questions where memory OF 

ases are likely to influence the re- 

sponse, €.g-, “How many bushels per acre did your 

lest crop yield?” may be followed by a question 


“What was the tax on your harvest?” 


at actater 


4,2 Incl 
personal bi 


Pretest the questionnaire. 

1 Try the cuestionnaire out on 
e 2 : 

analyze the results to see whether the d 


fem ation has been elicited. 


fellow staffers and 
esired 1n- 


Ss oe 
> Administer the questionnate to one OF more 


—embers of the target populetion, checking par- 
Aycational anomalies. 


cay 


seularly for cultural o7 € 
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6. Distribute the questionnaire. 


7. 


6.1 Include a cover letter in a mailed questionnaire. 

6.2 Include a self-addressed stamped envelope. 

6.3 Arrange for collection points for self-administered 
questionnaires and pick them up on schedule. 

6.4 Provide transportation for direct interviews (see 
Interviewing, IVW, page 23). 


Analyze the results. 

7.1 Begin the analysis as soon as the first questionnaire 
is returned. | 

7.2 Summarize the answers to open questions by list- 

ing the main points and the similarities or dif- 

ferences in responses. 

Aggregate the responses to closed questions and 

tabulate the frequencies in order to prepare a 

histogram (Histogram, HIS, page 131). 

Prepare a final report for transmission, including 

the original questionnaire as an appendix. 


7 


7.4 


EXAMPLE 


The following questions were taken from a question- 


naire designed to elicit basic data on farm wages as part of 
a cost-benefit analysis (CBA, page 212). The target popu- 


lation is the far 


mers along the Mai River in the country of 


Temasek. 


ls 
a 
a 


Name (optional) —————_______ 
Address (optional) ——————____ 
General location of farm (check one): 


© north of Mai River 
0 south of river 

© north of village 

C) south of village 


Size of farm: 


© smaller than one hectare 

O between one hectare and two hectares 
D larger than two hectares 

Number of farm workers (including members of 
family) ———____—_ 

Available at harvest time? ————————— 


. Did you hire farm labor this year? 


V eS stiemlanee 


_ If yes, how much did you pay? 


per hoprivaccens per day? —_—_—— 


How many did you hire?. ——————— 
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The questionnaire begins with general (neutral) ques- 
tions. Question 3 is aclosed question whereas question 5 is 
open (but quantified). 

If the number of farm workers needs to be cross 
checked, the questions on members of the family available 
for farm work can be used. However, even such relatively 
straightforward questions can lead to unreliable responses. 
How does the farmer define “family’’? Is the extended 
family included? A careful pretest would probably result 
in a better specification of these questions. 


THEORY 


The theory of questionnaire design is documented ina 
number of texts addressed to survey research (Festinger 
and Katz, 1953; Warwick and Lininger, 1975). The theory 
is based on numerous empirical studies including the ef- 
fects on the return rate of factors such as different ques- 
tionnaire layouts, the color of Paper, or the length of the 


questionnaire. However, there is no substitute for *X Deri- 
ence (including pre-testing): each situation is uUnigue. 
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Interviews 


PREREQUISITE TOOLS 


Questionnaires (QIN, page 19). 


USAGE 


PURPOSE 


An interview generates ideas and 
by posing relevant questions to the respondent(s). 


gathers information 


wSes 


ration. 
Collecting information and ideas from a selected 
semsvle within a target population (see Surveys, SVY, page 
3) Eliciting information and ideas from experts or pro- 
fessionals, e.g., agency representatives. 


KEY DEFINITION 
An interview schedule is the plen fo: conducting an 
ictervjew. It includes the questions to be posed. 


SHORT DESCRIPTION 


Ive interpersonal transacznons. Ine 


Tacerviews Mmvo. 
contuct, and results of che interview are de- 


cee nels egney ese eee een eeeer 


termined largely by the participants. The interviewer may 
be specially trained. The interview schedule may be struc- 
tured (closed questions) or unstructured (open questions 
and discussion). The respondent may bea professional, a 
project participant, or a randomly selected member of a 
target population. The combination of these factors is 
dictated by the purpose of the interview and the topic of 


inquiry. 


ADVANTAGES 

1) An interview provides a degree of flexibility in ob- 
taining information and generating ideas that is not likely 
to occur in impersonal transactions, e.g., a mailed ques- 
tionnaire. 

2) The questions may be adapted during the course of 
the interview in response to immediate feedback from the 
respondent. 

3) Face-to-face interaction tends to heighten the re- 
spondent’s interest in participation and forces him or her 
to consider the questions immediately. 

4) Where information must be gathered from an il- 
literate or semi-literate population, interviews may be the 


only effective instrument. 
5) The interviewer can use cues other then the content 


of responses to assess their validity. 


LIMITATIONS 


1) When several people have to be interviewed on 


similar topics, or where a wide range of issues has to be 
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covered, the necessary resources may be cost-prohibitive Ideally, the interview should take place in a location 
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when compared to using questionnaires (QTN, page 19). free from distraction (noises, telepnone calls, children cr 
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2) An interviewer without the necessary skills may other onlookers, etc.). One technique used in a village 


: . . Es a3 0 ae ae Se 
alienate the respondents or allow him or her to dcminate household survey in India was to provide a hizhly visible 


distraction in the center of the village while the interview 


the exchange. 
3) Where the respondent is not motivated, theanswers team discretely circulated among the houses. 


+) If creativity or the discussion and evaluation of 


ideas are required, group processes such as Nominal Group DESCRIPTION OF TOOL 


Technique (NGT, page 14) or Brainstorming (BSG, page 
3) may be more appropriate. REQUIRED INPUTS 


5) The anonymity of respondents (and thus their The purpose of the interview must be established and 


should guide subsequent decisions. If the interview is the 
measuring instrument for a sample survey (SVY, paze 
36), the target population will have been selected anda 


candor) cannot be ensured. 
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If the interview seeks ideas and information from ex- 
LEVEL OF EFFORT perts in different fields, the preparations and the training 


of the interviewer will differ. In all cases, however, the 


Gathering information by direct interviews can be a 
purposes must be established in advance. 


major effort bounded by the amount of information 
sought and the number of interviews desired. A follow-up 


interview may be necessary. Special training is required for 


TOOL OUTPUT 
An interview usually results in a report or tabulated 
responses which may be analyzed and transmitted to deci- 


MO LELEVEL sion makers. The data may be in the form of a histogram 
(HIS, page 131), a statement of preferences, etc. Often, 
the report will be swengthened by including illustrative 
responses to key questions, but unprocessed responses are 


seldom useful. 


interviewers. 


An interviewer must have certain skills to ensure proper 
and effective interaction (Bocchino, B97 2): 

1) Training to recognize his/her own prejudices in 
order to maintain an open mind. 

2) Giving credit wherever due and publicly acknowl- 


edzing help. 
3) Emphasizing courtesy and respect. IMPORTANT ASSUMPTIONS 
: sie the a of the respondent. The interviewer is assumed to be an unbiase d, noninter- 
) Listening more than talking. active transmitter of information and ideas. Where this is 


not the case (either by design or circumstance), the infor- 

TIME REQUIRED _mation must be appropriately interpreted. For example, 

the manner and style of the interviewer may trigger more 

Preparing for an interview takes about a day. An inter- negative (or positive) responses than expected for a 

view lasting longer than an hour usually results in ~ Asuerat reporting instrument (e.g., a self-administered 
diminishing returns. Time must be budgeted to write the questionnaire). 


interview report. 


SPECIAL REQUIREMENTS METHOD OF USE 


Electronic recording (audio or video) of questions and 
respon um e- i i 
sponses can be agreat cume-saver and can allow the inter- The following steps are useful guidelines for planning 
viewer to give full attention to the responses. However, and conducting an interview 
there are some costs, such as (anscription expenses and 
the possible loss of candor by the respondent. Ifelectronic 4. Specify the purpose of the interview 


equipment is to be used, the respondent’s prior permission 
IS 2sseng i i i i 
neal, 2. Determine who is to be interviewed. 


GENERAL PROCEDURE 
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3. Prepare an interview schedule. 

3.1 Design the questionnaire and determine the type 
of responses to be allowed (Questionnaires, QTN, 
page 19). 

3.2 Determine how the responses are to be recorded 
and, if necessary, develop a coded form. 

3.3 Make provisions for transcribing electronically re- 
corded interviews (optional). 


4. Select and train interviewers (optional). 
4.1 Select interviewers based on the types of re- 
spondents. 
4.2 Train interviewers to eliminate biases and provide 
for uniform reporting. 
4.3 Pretest all questions and anticipate ambiguities. 


5. Conduct the interviews. 
5.1 Arrange for transportation. 
5.2 Notify respondents in advance (optional). 
5.3 Arrange for immediate collection of reports. 


6. Synthesize and analyze the responses. 

6.1 Begin immediately to eliminate ambiguous re- 
sponses in Case corrections are necessary. 

6.2 Report the overall] results in a form suitable for 
transmission to others (e.g., consider such fac- 
tors as anonymity of respondents, biases of 
interviewers, and systematic distortions in re- 


sponses). 


EXAMPLES 
Rather than present the protocol of an interview, the 


following exam ples describe recommended procedures for 
conducting two very different kinds of interviews. 


Interviewing a Peasant Population 
for an Aid Project 
The following considerations were recommended by a 
colleague with extensive field experiences in data gather- 


ing (Ingersoll, 1976). 


i. Entry 
If the inteniew is not simply an academic pursuit of 


knowledge but project centered, the participant will have 
a much greater incentive to participate. Factors to con- 
s.der in planning the interview include: cultural values, the 
iifluence of the extended family, outsiders sitting in on 
che interview, and differences in perceptions of space, 


time, and quantity. 


Respondent in center 
\ieke the respondent the center of attention during the 


Wreatse tot 


sme 
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erview. Be sensitive to participants who need cues to 
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continue, Pay attention to answers. Don’t divert attention 
to the mechanics of filling out forms. 


3. The interviewer’s posture 

The ideal is neutrality, although it may be necessary to 
be positive to the respondent’s views in order for the inter- 
view to proceed. Receive all replies with interest. Avoid 
body English, e.g.,nodding. Engage in active listening, e.g., 
repeating exactly what the person says. Decide how to 
handle confusion over a question, e.g., rephrasing a ques- 
tion or giving an example. Note any further probe into a 
question for inclusion in the report of the interview. 


4. Departure 
Make sure that the respondent is not left with false im- 


pressions, e.g., that a new road will be built as an im- 
mediate result of his participation. Give some praise if new 
information and ideas have been volunteered. Signal the 
end of the formal interview, e.g., closing up the clipboard. 
Observe the social amenities upon departure, e.g., small 
talk. One may have to come back with more questions. 


Interviewing a Professional 
or a Decision Maker 
The situation is far different when the respondent oc- 
cupies a status position in an academic, business, or 
governmental organization. Hartman (1968) recommends 
the following steps for a successful interview: 


1. Prepare for the interview. 

1.1 Research the background of the respondent to be- 
come familiar with any special terminology or 
jargon. 

1.2 Schedule the interview well in advance to allow 
the respondent time to prepare. 

1.3 Arrange the interview through the respondent’s 
immediate superior (where this is feasible) to as- 
sure the respondent that his participation is impor- 


tant and approved. 
1.4 Get the respondent’s correct name and title in ad- 


vance, 
1.5 Avoid scheduling interviews for late in the day, 


just after mealtime, or just before a weekend. 


2. Conduct the interview. 
2.1 Introduce yourself and clarify the purpose of the 


interview even if there has been prior notification. 

2.2 Keep the interview to the subject—respect the de- 
mands on each other's time. 

2.3 Start the interview with broad questions. 

2.4 If the responses are not satisfactory, emphasize 
the importance of the respondent’s views for the 


decision-m aking process. 
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Allow the respondent to think during occasional 


2.5 
periods of silence. 

2.6 When a reply is unclear, ask the respondent to 
separate opinions from facts. 

2.7 Don’t let note-taking interrupt the normal flow of 
discussion; use abbreviations and symbols or elec- 
tronic recording (with prior permission). 

2.8 Conclude the interview by allowing a few minutes 


for informal conversation and summation. Often 
these comments may divulge useful information 
and may give an indication of the validity or sin- 


cerity of the previous responses. 


3. Follow up the interview. 
3.1 Prepare the report of the interview immediately. 


3.2 If a follow-up interview is necessary, send the re- 
port (or a digest of the first interview) to the 
respondent in advance. 

3.3 In all cases, senda formal thank you to the respon- 
dent and his supervisor acknowledging their co- 


Operation. 


THEORY 


There is no theory of interviewing in the sense of 
general laws or “truths.”’ Each interview is different. How- 
ever, there is some merit to taking a systems approach to 
the design of an interview, particularly when used as the 
measuring instrument for sample surveys (Surveys, SVY, 
page 36). 

An interview is analogous to a communication system 
having four principal components (Warwick and Lininger, 
1975, p. 184): 

The interviewer 

The respondent 

The study content or topic 
The interview situation 


Each of these factors interact to determine the efiiciency 
and effectiveness of the interview. The efficiency concerns 
the amount of information gathered per unit of time and 
cost. The effectiveness relates to the usefulness of the 
ideas or information gathered. For example, the inter- 
viewer and/or the respondent can introduce both biases 
and distortion into the information gathered. Conse- 
quently, if interviewing isto be an effective technique, the 
specification of any one of the components must take into 
account the interaction with the other factors, i.e., de- 
signed as an information-gathering system (Hartman, et 


al., 1968). 
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Assessing 
ualitative Factors 


Rating Scales 
Multiple Criteria Utility Assessment 
Surveys 
Organizational Climate Analysis 
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There is a danger in project desicn and systems modeling of overlooking a factor because 
it is not in quantitative form. Techn iques for assessing qualitative factors are essential to a 
systems approach, and four such techniques are described. Two are scaling procedures (Rat- 
ing Scales and Multiple Criteria Uniliry Assessment). The other techniques are broadly based 
esse ssiernit procedures (Surveys and Organizational Climate Analysis). All four provide 2 


means of transforming qualitative attributes into quantitative measures, though clearly the 


lattertwo havea vanety of uses. 
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Rating Scales 


PREREQUISITE TOOLS 


None, 


USAGE 
PURPOSE 


A rating scale measures the degree to which an entity 
Ossesses or exhibits a specified Property, as either an ab- 
sizte ora relative judgmen t. 


s 
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Rating scales are used to quanufy factors which may be 
highly subjective or qualitative in nature. Once the judg- 
Feat is scaled, the quandtative measure may be incor- 
rereted into analyses such as: 

ij Rating the individual utilities of Various criteria 
using Multiple Criterig Unility Assessment (MCU, page 
ay. 

2; Evzluating alternative decision sequences ina decj- 
S20 tree ‘DTR, paze 141), 

3; Evaluating alternative Plans. given various contin- 
cSicies which may be expected to occu, (Contingency 
thalysis, CGA. Page 147), 

+; Ranking alternatives as in Nominz] Group Tech- 


ius (NGT. page 14} and Delphi ‘DLP, pace 168), 


KEY DEFINITIONS 

There are four Primary types of rating scales (see figure 
1): 

1) Nominal scales simply categorize different factors, 
e.g., hot/cold, dark/light, and black/gray/white represent 
nominal scales for heat, illumination, and color. 


2) Ordinal scales are used to rank-order a set of similar 
objects along a criterion dimension which reflects a basis 
for comparison, but not the degree of difference, e.g, 
warm, warmer, hot, hotter, hottest are ordinal rankings of 
heat sensation, 

3) Interval scales reflect not only the rank of one 
factor over another, but the depree to which one exceeds 
the other. The difference between them corresponds toa 
length of scale interval. The zero point is arbitrary. 


4) A ratio scale is an interval scale for which the dimen- 
sion of comparison hasa Natural zero point, e.g., the cent- 
grade temperature scale, 


SHORT DESCRIPTION 

Rating scales are described by their uses: 

1) To rank the preferences for a set of factors: ordinal 
and interval scales. 

2) To classify or Categorize a dissimilar set of factors: 
nominal scales, 
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FIGURE 1 
Examples of Rating Scales Applied to Discrimination Among Three Projects 


Nominal Scale 
ACCEPTABLE: 


Project 1 
Project 3 


2nd Priority 


NOT ACCEPTABLE: 


Project 2 


Ordinal Scale 


Ist Priority 
Project 3 


Project 1 


3rd Priority 


Interval Scale 


Project 3 


Project 1 


NET BENEFIT 
in thousands) 
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1 prdpeeed 


Project 2 


3) To indicate the degree one factor exceeds another SKILLLEVEL 


on a specified basis of comparison: interval and ratio 


scales. 
The scale selected determines how discriminating the 


rater can be. 


ADVANTAGES 

Rating scales allow a quantitative comparison. If the 
comparison involves several factors, the discrimination be- 
tween factors is enhanced by relating it to a physical di- 
mension (the position or interval on ratio scales). 

Factors quantified on rating scales may be combined to 
reflect a quantitative assessment of cumulative effect, e.g., 


the pooled judgments of a group ofraters. 


LIMITATIONS 

Rating scales are constructed by subjective judgments 
in the assignment of rank or interval on the scale. This fact 
is sometimes lost when the rating is transferred to other 
tasks or used as information in other tasks. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

The major task is to assign the rating for each factor. 
This may be an involved or a straightforward process, de- 
sending on the ultimate use of the rating. For example, 
ating may be used directly as part of cost-benefit analysis 
CBA, page 212) or as an aggregated form toreflect multi- 
sle dimensions of discrimination (MCU, page 32). The 
geregation process tends to minimize the contribution of 


ny one rating. 


Expertise is required in selecting the appropriate kind 
of rating scale and its parameters. The rating process is sub- 
jective and may combine the individual judgments of ex- 
perts or project clients (see Delphi, DLP, page 168). 


TIME REQUIRED 

Nominal scales usually require little time since only 
classification is involved. Ordinal scales can be constructed 
quickly, particularly if only a few factors are to be ranked. 
Interval and ratio scales may require more time to con- 
struct and establish ratings because more judgment is 
involved. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 

The inputs required are simply the scale selected for the 
ratings (nominal, ordinal, etc.) and the set of factors to be 
rated. If the rating is to be conducted by someone other 
than the person who constructed the scale, a sample rating 
is useful to illustrate the process. The dimension on which 
the comparisons and contrasts are to be made must be 
clearly identified and understood. 


TOOL OUTPUT 
The output is a rating scale which quantifies the subjec- 


tive assessment of the factors. 


IMPORTANT ASSUMPTIONS 


The construction and application of rating scales rest 
on the assumption that humans can discriminate along the 
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rating dimension. There are two limiting factors involved: 
comparative and absolute judgment. The first suppests 
that humans are limited in their ability to discriminate 
berween two adjacent factors along dimensions such as 
color, tone, volume, smell, size, length, etc. The second 
suggests that the number of discrete intervals which may 
be recognized along any one dimension is limited. For ex- 
ample, we recognize only four different tastes: sweet, 
sour, salt, and bitter. Discrimination is based on a combi- 
nation of taste, texture, smell, and appearance. The im ph- 
cation is that it would be unproductive (and misleading) to 
ask the rater to distinguish more intervals than he is 
psycho-physiologically able to (Garner, 1960), 


METHOD OF USE 
GENERAL PROCEDURE 


1. Determine the attributes or factors to be rated. 
2. Determine the best scale for rating the factor. 
2.1 Consider the degree of subjective judgment that is 
feasible. 
2.53 Determine the time available and the discrimina- 
ton desired. 
- Construct the rating scale. 
. Rare the attributes or factors. 
. Verify the consistency of the ratings. 


ws) 
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EXAMPLES 
Nominal Scale 

Any classification system represents a nominal scaling 
of virizbles luPag example, the tools in this handbook are 
cteecrized nominally by their major Purpose. In general, 
che nominal classification of items is possible only if the 
caiezories are mutually exclusive and exhaustive. The 
'te> regvirement is usually met by a catch-all] category, 
-§- “Reneef theabove™ 


Ordinal Scale 
2h278 are several examples of the construction and ap- 
P=Cition of ordinal Scales in this handbook, e.g., the rank- 
tcderinz method Cescribed in Nominal Group Techniques 


Sst NGT, sere 14), 
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Interval and Ratio Scales 
Interval scales are used in assessing utility functions 
(see Multiple-Criteria Utility Assessment, MCU, page 
32). Subjective Probability Assessment (SPA, page 137) 
requires an interval scale to rate the likelihood of events 
occurring. Krueckeberg (1974) describes the use of 
rating scales in urban planning. 


THEORY 


Rating scales are based on the theory of psycho. 
physical measurement (Garner, 1960). The literature of 
psy chology, sociology, and decision making abounds with 


empirical studies on the subject. 
Two works are of particular interest: Kaufman (1976) 


describes rating scales in a treatment of a systems ap- 
Proach to iden tifying and solving problems. Kneppreth, et 
al. (1972) catalog a number of different worth assessment 
techniques. Other studies (Huber, et al., 1969) deal with 
the issues of the aggregating group judgments. The results 
are significant, Particularly where priorities are to be 
ranked in such a way that second and third choices are in- 


cluded. 
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Multiple Criteria 
Utility Assessment 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


Multiple Criteria utility assessment is a systematic pro- 
cedure for assessing the worth of complex alternatives. 


USES 
Utility assessment provides a common scale for com 
bining judgments on more than one dimension. The tech- 


nique is used to: 
1) Evaluate alternatives using more than one criterion. 
2) Combine effectiveness measures into a single aggre- 
gated utility, e.g., as in cost-effectiveness analysis (CEA, 


page 219). 


3) Determine a common criterion for valuing the pos 
sible outcomes in a decision under risk (see Decision Trees, 


DTR, page141). 


4) Provide acommon measure for comparing the per- 
formance of alternative plans (e.g., Contingency Analysis, 


CGA, page 147). 


KEY DEFINITIONS 
1) Utility is a quantitative expression of the worth or 
satisfaction associated with an outcome. 


2) Autility function associates the possible levels acri 
terion may take with the utilities for those levels. 

3) Autility matrix presents the elements of a decision 
under certainty: alternatives, criteria for evaluating the al- 
ternatives, weights indicating the relative importance of 
the criteria, and the assessed utilities (see figure 1). 


FIGURE 1 
Utility Matrix for Evalua ting Alternatives 


ALTERNATIVES 


SHORT DESCRIPTION 
In order to compare and evaluate various alternatives 
(A, B,...), several criteria (x1, *2,...) are first specified 


(see figure 1). The decision maker considers each criterion 
separately, assessing the relative utility for different crite- 
rion levels. The criteria are weighted to represent their 
relative importance to the decision maker, The aggregate 
utility foreach alternative is determined by computing the 
weighted sum of the individual utilities for each criterion. 
Alternatives are compared on the basis of overall utilities. 
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ADVANTAGES 

Valuing alternatives using measures like expected pay- 
off or costs ignores the preferences the decision maker 
may have for incremental benefits or costs. Utility assess- 
ments transform these preferences into quantitative scales 


which can be combined to determine aggregate utility. 
Where a complex alternative must be evaluated, this 


technique requires the decision maker to consider only 
one criterion at a time. This simplifies the assessment task 
and increases the consistency of su bjective judgments. 


LIMITATIONS 

Not all qualitative criteria can be assessed quantita- 
tively, e.g., political acceptability. Multiple criteria utility 
assessment makes no allowance for preferences which 


change over time. 


REQUIRED RESOURCES 


LEVELOF EFFORT 


Multiple criteria utility assessment requires the cooper- 
ation of the analyst and the decision maker. The analyst 
frames the decision situation by identifying alternatives 
and working with the decision maker to specify criteria for 
evaluating the alternatives. The decision maker quantifies 
his preferences in the form of a utility function for each 
crterion. Ageregating utilities is then a straightforward 
analvdcal task. 


SKILLEEVEL 

Effective communication between analyst and decision 
maker is essential for eliciting utility functions and weight. 
ng criteria. The analyst must be able to evaluate the de- 
ge to which each alternative meets the criterion in ques- 
ton. a process which can involve subjective judgment. 


TIME REQUIRED 
Determining utility functions and checking for consis- 
tency can take half a day. Otherwise, the computations 


end evaluztions are not time-consuming, provided neces. 
sary information is available. 


DESCRIPTION OF TOOL 
REQUIRED INPUTS 


teria by which the alternatives are judged must 
recited. The criteria may be derived from an analy sis 
Coizctives ‘Objective Trees, ORT, page 49) or from the 
“acure cf the decision situation, The alternatives must be 
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FIGURE2 
Utility Function 
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sufficiently detailed so that the decision maker can judge 
the extent to which each meets the criteria, 


TOOL OUTPUT 


The first products of the multiple criteria utility assess. 
ment technique are the unity functions corresponding to 
each criterion (see figure 2). These transfer the criterion 
levels to utilities (e.g., the utility of 65 bushels per hectare 
is 75*). Utility functions can be analyzed to indicate the 
underlying preferences of the decision makers, €.g., a pref- 
erence to avoid risk (see Bierman, etal., 1 973). 

In a decision situation, the ultimate result isa quantita- 
tive ranking of the alternatives by decreasing aggregate 
utility. This measure can be used in other techniques 
where alternatives are evaluated using multiple criteria 
(e.g., Cost-Effectiveness Analysis, CEA, Page 219), 


IMPORTANT ASSUMPTIONS 


Utility is a measure of satisfaction with an outcome 
and has the property of additivity. Utilities assessed for 
more than one criterion may be added to indicate 3 prefer- 
ence based on complex multi-dimensional judgments (see 
Rating Scales, RTS, page 29), 

The criteria applicable to a decision are fixed dimen. 
sions for assessing the degree to which an alternative pos- 
sesses each of the attributes, e.g., the dimensions do not 
vary from alternative to alternative in the decision situa- 
tion although the criterion level for each alternative Varies. 
That is, subjective preferences are consistently applied to 
all alternatives in the decision situation. 


aT ; 
Utilities are dimensionless, but may be thought of as Percentace 
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METHOD OF USE 
GENERAL PROCEDURE 


1. Identify the decision criteria used to assess each alter- 

Native. 

1.1 Determine nominal scale categories for the quali- 
tative criteria (see Rating Scales, RTS, page 29). 

1.2 Determine the practical limits for quantifiable 
criteria, e.g., yield per hectare may range from 10 
to 105 bushels. 


2. Construct a utility function for each qualitative crite- 

rion. 

2.1 Identify a most preferred and a least preferred 
level. 

2.2 Assign utilities of 100% and 0% satisfaction. 

2.3 Assess the utilities for intermediate levels of the 


criterion. 


. Construct utility functions for each quantitative crite- 
rion. 

3.1 Assign 100% utility to the quantitative criterion 
level, just beyond the practical limit which is most 
preferred. 

Assign 0% utility to the criterion level at the other 
extreme of the practical range of values. 

Assess the utility value which indicates the per- 
centage satisfaction with intermediate criterion 
levels, e.g, “if your satisfaction with a harvest of 
105 bushels is 100%, then what is vour satisfaction 
with 60 bushels per hectare?” 

3.4 Connect a curved line through the intermediate 


utility values (see figure 2). 


BM 
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. Test the internal consistency of the utility assessments. 

4.1 Pose questions like: ‘‘You have said that you 
would be 25% satisfied with 35 bushels and 75% 
satisfied with 60 bushels. Are 60 bushels actually 
preferred three times as much as 35 bushels?” 

4,2 If the answer is no, then adjust one or both utility 


assessments. 


5. Considering one criterion at a time, determine the util- 

ity for each alternative. 

5.1 Construct the utility matrix (figure 1). 

5.2 Using the utility function for the respective crite- 
rion, evaluate the utilities for the various alterna- 
tives by assessing the criterion level achieved by 
each and then using the utility function to read off 
the corresponding utility. 

5.3 Enter these percentages in the rows corresponding 
to that criterion of the utility matrix. 
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FIGURE 3 
Utilicy Functions for Evaluating 
Farmer Contact Strategies 


Criterion 1: Number of farmers contacted per year 


Utility 
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Criterion 3: Accessibility by farmers 
Utility 
100 


50 eedhee —enrh we eae abn 


Uas 25 


high 


medium 


Accessibility 


SPY a he | 
BTS ee, Coe eee? 


MULTIPLE CRITERIA UTILITY ASSESSMENT / 35 


Z Weight the criteria. | 

6.1 Ask the decision maker to order the criteria by in- 
creasing importance to the decision. 

6.2 Assign a weight of 1.0 to the most important cri- 
teria. 

6.3 Ask the decision maker to indicate the fraction 
corresponding to each remaining criteria, e.g., ‘‘is 
this criterion one-half or one-third as important as 
the most important criterion?” 


7. Compute the aggregated utilities. 
7.1 Multiply each utility by the weight assigned to the 
respective criterion for that row of the matrix. 
7.2 Compute the aggregated utility for an alternative 
by summing the weighted utilities across all cr. 
teria. Referring to figure J, for alternative A: 


Aggregate utility of A=w,Ua, +...+w,Ua, 


where 

Ua, =utility of alternative A for criterion n 

Wn = weight of nth criterion (a positive fraction 
less than 1) 


7.3 Rank-order the alternatives by descending values 
of their ageregated utility. The alternative giving 
the greatest satisfaction is the one having the great- 
est ageregated utility. 


EXAMPLE 


The Temasek Ministry of Agriculture was considering 
two zlternatives for disseminating innovations to small 
iarmers: A) establishing farmer training centers at stra- 
tegic locations in the region, or B) strengthening and ex- 
pancing the agricultural extension service. The effective- 
ness of the alternatives were evaluated using three criteria: 
1) the number of farmers contacted per year; 2) the per- 
centage of farmers contacted having holdings of 10 hec- 
tarés or less: and 3} the accessibility of the approach, Crite- 
non (3) was formulated as a qualitative assessment of the 
ease with which farmers could use the system, 

Uruity functions were derived for the three criteria (see 
te 3). The NSnistry of Agriculture decision makers 
placed a hich uthity on reaching a significant percentage of 
small farmers. Also, no utility was associated with reach- 
ing less than 500 farmers as this was the present level of 
contact for the existing extension program. The practical 
limit for criterion (1) was the total number of farmers in 
the ree:6n, estimated ar 10,000. 

A volte matrix was constructed, and the utilities of 
ie alternatives were evaluated (see figure 4), Considering 
e=teron (2). the mobile extension workers could be more 
abide in contacting farmers, while only the larger farm. 
fC Use the training center services. 


FIGURE 4 
Utility Matrix for Ministry of Agriculture 
Farmer Contact Strategy 


Alternatives 


A) B) 
Training Strengthened 
Criteria W Centers Extension 


1. Total farmers 
contacted 

2. Percentage 
small farmers 

3. Accessibility 


60 
50 
75 


The importance of each criterion was evaluated and 
weights were assigned (see figure 4). The total number of 
farmers reached was judged to be twice as important as the 
other decision criteria. The weighted agerepate utility for 
each utility was computed. For example: 

Aggregate utility for alternative A = (1.0)(90) + (0.5)(75) 
= (0.5)(25) = 140 


Weighted total 


The weighted aggregate utility for alternative B was com- 
puted at 123. Consequently, the farmer training center 
strategy was preferred. The aggregated utilities were then 
compared to projected costs (see Cost-Effectiveness Anal- 


ysis, CEA, page 219). 


THEORY 


Huber (1974) identifies two methods by which multi- 
ple criteria utility assessment is carried out. The method 
shown here has been the client-explicated model, since the 
client (decision maker) indicates his utility for various 
levels of each criterion. In the observer-derived model, the 
client is asked to make a global judgment of the overall 
utility associated with a set of criterion levels. The client 
estimates the utility for several such sets; regression anal- 
ysis (see Regression Forecasting, RGF, page 160) is used 
to estimate the utilities associated with each criterion. 
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Surveys 


PREREQUISITE TOOLS 


Questionnaires, QTN, page 19. 


USAGE 


PURPOSE 
A sample survey is used to gather information from a 
fraction of a subject population in order to identify and 


measure its attributes. 


USES 

A sample survey can be used to: 

1) Explore the issues, opinions, and attitudes of inhab- 
itants of aregion or aselected target population. 

2) Test fundamental hypotheses and assumptions 
which have been developed by a pilot study or other ex- 


periment. 


3) Provide feedback on the progress of a project by 


measuring the delivery of services. 
4) Form the basis for a post facto evaluation of the 


overall effectiveness of a project by measuring its impact 


on recipients and non-recipients. 
5) Quantify statistical data used in the cost-benefit 
analysis (CBA, page 212) and cost-effectiveness analysis 


(CEA, page 219) of proposed projects. 


KEY DEFINITIONS 


1) A subject population is the set of all events or enté 
ties which possess certain specified characteristics, e.g., all 
married couples in a region of the country of Temasek. 

2) A sample is a subset selected from a subject popu!a- 
tion, the attributes of which are assumed to hold true for 
the total population. 

3) A measuring instrument is a technique for eliciting 
and measuring responses from a subject. 

4) A census isa survey of all members of a subject pop 
ulation. 

5) Participant observation is the gathering of informa- 
tion about and impressions of a selected group by direct 
interaction over an extended period of time, e.g., a social 
scientist living in a village to interact and observe behavior 
patterns, social relationships, and economic structures. 


SHORT DESCRIPTION 


A sample survey is a means of gathering maximum in- 
formation at minimum cost. A sample of the subject popu- 
lation is selected based on the purpose of the survey and 
time and cost limitations. Two common measuring instru- 
ments are used to gather information: interviews (1VW, 
page 23) and questionnaires (QTN, page 19). They may 
be used together and administered by trained personnel. 

Survey results are tabulated and analyzed in order to 
assess characteristics of the subject population. Surveys 
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arc used in evaluation research for the “‘assessment of the 
process and/or consequences of deliberate and planned 
interventions” (Warwick and Lininger, 1975, page 51). 
Using rating scales (RTS, page 29) and statistics (see Histo- 
crams, HIS, page 131), the analyst makes inferences about 
che need for, the progress of, and the impact of develop- 
ment projects. These inferences are tested using the sam- 


ple survey results. 


ADVANTAGES 

1) Information about a population may be gathered 
from a fraction of the population. This minimizes expen- 
sive data gathering costs. 

2) A great deal of information can be gathered by 
making a careful selection of a representative sample. 

3) In contrast to participant observation, a carefully 
designed survey permits generalization about the char- 
actenstics of the population as a whole. 

4} Because fewer interviewers are required than for a 
census, the training and control over them is usually 


better. 


LIMOTATIONS 

Even a smal] survey may be prohibitively expensive, 
particularly if accessibility to the subject population and 
training personnel are factors. 

Biases in the information gathered and the sampling 
procedure may lead to erroneous inferences. 

The return for mailed questonnaires is typically very 
low and may jeopardize the validity of the results. How- 
ever. personal interviews introduce an additional source of 
bizs ‘see Interviews, IVW, page 23). 

A sample survey is less useful than Participant observa- 
on when the analyst knows little about the society under 


itudy. 
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REQUIRED RESOURCES 


LEVELOF EFFORT 


Surveys are normally major undertakings, The decision 
maker will heve to weight the costs against the benefits 
see Cost-Benefit Analysis, CBA, page 212) before under- 
tain the sirvey. The analyst will expendthe major effort 


Fahad 
fonine the survey end het 
tie survey and analyzing the responses. If 


= Césizning 
“Siemiewing is desirable, the selection, training, and super- 
“9 cfintersiewers is crucial. 
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SKILL LEVEL 

Survey design requires a good deal of research know. 
ledge and statistical sophistication. Skills in selecting 
representative samples, constructing questionnaires, and 


analyzing data are essential. 


TIME REQUIRED 

A sample survey can be a very time-consuming process, 
not only in actually conducting the survey but in the plan- 
ning and analysis stages. A critical path schedule is pre- 
sented as an example in Gantt Charts (GNT, page 252) for 


a 33-day task. 


SPECIAL REQUIREMENTS 

A vanety of statistical packages are available on com- 
puter programs, However, to use them to analyze sample 
survey results, the data must be coded in compatible for- 
mats (see Questionnaires, QTN, page 19). Though not 
strictly necessary, computerized techniques have the great 
advantage of shortening the time required to analyze re- 
sults and permitting complex statistical measures to be de- 


rived from the data. 


DESCRIPTION OF TOOL 
SUPPLEMENTAL DEFINITIONS 


1) A simple random sample is made so that every mem- 
ber of the target population has an equal probability of 
selection. 

2) A stratified sample selects a proportional sample at 
random from each of the groups in a stratification of the 
total population, e.g., the sample includes an equal num- 
ber of randomly selected individuals from low, middle, 
and high income strata. 

3) Cluster sampling is the process of randomly select- 
ing several clusters of subgroups from the total population 
and surveying all members of the selected subgroups, e.g., 
only three villages are selected in the region of the subject 
population, but every inhabitant of the village is inter- 
viewed. 

4) Mu lti-stage sampling draws random samples in 
stages. The first stage selects random groups within the tar- 
get population. A second stage randomly selects sub- 
groups (or individuals) from within the groups, and soon. 


REQUIRED INPUTS 
The problem definition, the desired subject popula- 
tion, the measuring instruments, and the sample size are 


38 / ASSESSING QUALITATIVE FACTORS 


necessary inputs for a survey. The decision maker has to 
interact with the analyst to determine the sample size. The 
size will affect costs as well as reliability. A choice between 
potential measu ring instruments is made depending on the 
type of problem being faced, the costs of using the instru- 
ment, and the expected time lag before arriving at a final 
-analysis, 


TOOL OUTPUT 


The tabulation of the responses is of primary interest to 
the decision maker, The simplest type of output would be 


marginal tabulations, indicating how the population is dis- 


tributed across alist of categories. For example: 


Religion Percentage of Population 
Protesrarr 15% 
Catholic 5% 
Muslim 30% 
Buddhist 40% 
Other 10% 
TOTAL 100% 


Hence, Muslims would form 30% of the subject popula- 


tion (see Histograms, HIS, page 131). 


Another output is “correlation analysis.” This analysis 
shows how variables are related to each other. For exam 


ple: 
Response on Pixthn Control 

Opposed Indifferent Agree 
Protestant 5% 5% 90% 
Catholic 60% 30% 10% 
Muslim 55% 10% 35% 
Buddhist 10% 10% 80% 
Other 2% 15% 83% 


This output would indicate that Catholics and Muslims 
generally oppose birth control. Hence, the decision maker 
may have to consider strategies to establish linkages with 
Catholic and Muslim priests if birth control is to be imple- 
mented (see Regression Forecasting, RGF, page 160). 

A final type of output is due to “longitudinal re- 
search,’’ where the attributes of a population are measured 
at two or more points in time. The results are used to indi- 
cate changes in measured attributes which are caused by 
planned interventions. For example, the effectiveness of a 
birth control education program would be assessed by re- 
peating the survey of attitudes at several intervals after the 


program had started. 


IMPORTANT ASSUMPTIONS 


A sample population can be randcmly selected 
representative of the subject pooulation. Measuring instr. 
ments are unbiased. The inferences from the samp!e re- 
sults to the target population are statistically valid. 


to be 


METHOD OF USE 


GENERAL PROCEDURE 

Since sample surveys vary greatly in purpose, design, 
and execution, below is a broad sketch of the steps 
involved (for a more detailed description, see, for exam. 
ple, Warwick and Lininger, 1975). 


1. Specify the purpose of the survey and its uses. 


2. Identify the subject population. 
2.1 Consider the kinds of inferences which are to be 
made. 
2.2 Consider the accessibility and cooperativeness of 
the subject population (they may have already 
been saturated by Surveys Or experiments), 


3. Select a sample method: 
a) Simple random sam pling, 
b) Stratified sampling, 
c) Cluster sampling, or 
d) Multi-stage sam pling. 


4. Determine the best sampling size. 
4.1 Consider the desired accuracy and reliability of 
the survey results: the larger the sample, the more 
reliable the inferences about the target popula- 


tion. * 

Consider the cost of gathering data: the larger the 
sample, the more time or personnel required. 
Consider the cost of processing the data: unless 
the results are processed automatically, the 
smaller the sample, the less the cost in both time 
and effort. 

Consider the desired discrimination** in target 
population: the more homogeneous the target 
_ population, the smaller the sample may be. 


4.3 


4.4 


“Statistical reliability is proportional to the absolute sample size, 
not the fraction of the target population. 


“*This is related to the sam pling method selected and the consider- 
ation in 4.1. Statistical reliability of quantitative attributes can be 
Getermined analytically (see Warwick and Lininger, 1975). 


5. Specify the measuring instrument and train personnel. 
5.1 If a questionnaire is used, determine howit will be 
administered (see Questionnaires, QTN, page 

19). 
5.2 If direct interviews are used, select and train the 
interviewers, taking into account cultural compat- 


ibility with the target population. 


6. Design the survey questionnaire and pretest (see Ques- 

tionnaires, QTN, page 19). 

6.1 Determine if both open-ended and close-ended 
questions are necessary. The former will require 
more training and interpretive analysis of results. 

6.2 Correct any deficiencies in design by pretesting on 
a smal] sample of the target population. If this is 
not desirable, then pretest on a group which 
matches communication characteristics of the tar- 
get population, e.g., literacy level, candor, cooper- 
ativeness. 


7. Conduct the survey. 
7.1 Arrange necessary transportation. 
7.2 Monitor interviewers by spot-checking survey re- 
sults, 
7.3 Start analyzing results imme diately in case adjust- 
ments to the questionnaire or the interviewing 
procedure are necessary. 


8. Tabulate and analyze results. 
8.1 Prepare histograms for quantitative measures and 
Compute descriptive statistics (see Histograms, 
HIS, page 131), 
8.2 Interpret and summarize open-ended responses 
(see Delphi, DLP, page 168). 
8.3 Analyze results to test Statistical inferences, 


9. Report conclusions. 
9.1 Include questionnaire and sampling procedure as 
appendices, 
9.2 In addition to Presenting data and summary statis- 
tics, reflect on implications of the results. 


EXAMPLES 


The exaraples of sample surveys cross many fields and 
zddress a variety of purposes. Glock (1967) provides ex. 
amples of how surveys have been used in sociology, eco 
romcs, social work, and education. 

The Survey Research Unit (IUo and Lynch, 1975) has 
been extensively involved in data gathering for the Bicol 
River Intezered Development Program in the Phillipines. 
The isszes addressed range from social indicators such as 
“The Qcsksy of Life” te yield dataonrice production. 
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Mann (1974) describes a comprehensive survey con. 
ducted in Africa to identify the problems of small farmers, 


THEORY 


Survey research has developed into a theoretical area in 
its own right (Festinger and Katz, 1953, and Warwick and 
Lininger, 1975). Effective use of measuring instruments 
are described in Young (1956) and Cicourel (1964). 

The underlying theory upon which sample surveys are 
based is the process of statistical inference and hypotheses 
testing. Meyers and Grossen (1974) describe basic statis. 
tical methods, and Smith (1975) gives a useful treatment 
of these methods in relation to sample surveys designed to 
gather quantitative project data. Kearl (1 976) presents a 
collection of experiences, rules-of-thumb, and common 
sense in the design and execution of sample surveys. 
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Organizational 


Climate Analysis 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 

Organizational Climate Analysis determines the orga- 
nizational climate required to achieve desired behavior 
froma target group within an organization. 


USES 


Climate analysis may be used to: 

1) Identify organizational attributes (climate) which 
affect behavior. 

2) Compare the climates of similar organizations, e.z., 
secondary schools within a country, or divisions within an 


KEY DEFINITIONS 

1) Organizational climate is the relatively enduring 
quality of the internal environment of an organization 
that (a) is experienced by its members, (b) influences their 
behavior, and (c) can be described in terms of the values of 
a particular set of characteristics (or attributes) (Tagiuri, 


1968). 
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2) A target group isa number of individuals with some 
common roles or characteristics. Examples are students in 
a school and employees ina government agency. 

3) Organizational attributes include the elements or 
components of an organizational system and the inter- 
relationships among them. 

4) Measuring instruments are techniques for eliciting 
and measuring responses from a subject. Examples are 
questionnaires (QTN, page 19) and interviews (IVW, page 
23). 


SHORT DESCRIPTION 


A set of measurable organizational attributes which can 
be used as criteria for describing an organizaticn’s climate 
is determined. Measuring instruments, which engage 
people within the organization, are then utilized to deter- 
mine the desired values of these attributes and thus the de- 
sired organizational climate. The present organizational 
climate is then determined through observing and objec- 
tively measuring the behavior or performance of the target 
group. Analysis of the climate and behavior then leads toa 
proposed organizational climate which can encourage de- 


sired behavior. 


ADVANTAGES 


Quantitative measures of organizational attributes are 
identified which help to determine the achievement of the 


desired organizational climate. 
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LIMITATIONS 
1) If the people within an organization are unable to 

express their perceptions about the organizational at- 

tributes, then adequate measurements cannot be ob- 


tained. 
2) The analysis requires an external consultant whose 


services may be expensive. 
3) If the cooperation of the target group is not forth- 


coming, the results of the climate analysis may be invalid 


or unacceptable to the target group. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


The analyst will expend considerable effort helping the 
decision maker to identify the desired types of behavior 
and the organizational attributes of the climate: to pro- 


vide measures for these attributes, to construct measuring » 


instruments (and possibly administering them), and to 
analyze the results obtained. 


SRILLLEVEL 
The analyst should havea strong background in organi- 
zationa] theory and its related aspects in psychology and 


sociology. 


TIME REQUIRED 


The climate analysis is a major effort which takes at 
least a month. The time required varies with the size of the 
target group, the number of organizations, and the ac- 


curacy desired. 


DESCRIPTION OF TOOL 
REQUIRED INPUTS 


Perceptions about the organizational climate are so- 
ited not only from the target orou , but from other in- 
y eet oop 
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Cividuals within the Organization. 
Behavior may be judged by several criteria, including 
routine job performance, creativity, and scholastic ability, 
These are operationalized into measurable criteria, suchas 
number of cars assembled per hour, number of ideas 
generated, and grade point average, respectively. Objective 
Trses OBT. page 49) may be a useful technique for deter- 
TAINS tnese Ev iIteria, 

Sells (1958) identifies eight criteria to be considered in 


climate assessment (see figure 1). 
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FIGURE 1 
Dimensions to Be Considered in Climate Assessment 


. Objective and Goals 
a. Remoteness of goals 
b. Formal vs. informal mode of designation 
c. Unitary vs. multiple goals 

2. Philosophy and Value Systems 

a. Dominant economic values with respect to is- 


sues of property, profit, taxation, etc. 
b. Status and value accorded the individual, 


minorities, dependent individuals, and groups 


3. Personnel Composition 
a. Intellectual potential 
b. Physical traits 
c. Position in status hierarchy 


4. Organization 
a. Size 
b. Differentiation 
c. Autonomy 


5. Technology 
a. Products and services involved 
b. Types and degree of technological complexity 


6. Physical Environment 
a. Social isolation 
b. Types of furnishings 


7. Social-Cultural Environment 
de Language 
b. Living standards and routines 


c. Recreation 


- Temporal Characteristics 
a. Duration of individual participation 
b. Extent of daily participation 


TOOL OUTPUT 


The analyst will tell the organizational decision 
maker(s) which organizational attributes are aiding and 
which are hindering achievement of the desired behavior. 
Discussion between the analyst and the decision maker 
will then determine the changes to be made inthe organi- 


zational climate. 


METHOD OF USE | 


GENERAL PROCEDURE 
This procedure may be followed in a climate analysis. 
Note that these steps are meant to provide only a general 


understanding, 
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1. Determine the basis fora climate analysis, 
1.1 Identify the target group (in consultation with the 
decision maker), 
1.2 Define desired behavior from the target group. 
i? comparison of organizations is to be done, 
determine the number to be included in the study. 


2. Obtain operational definitions of climate and behavior. 


2.1 Identify one or more measurable attributes for the 
Organizational climate. The attributes may be 
comprehensive or they may be selectively per- 
ceived. 

2.2 Define objective criteria for measuring behavior. 


3. Measure climate and behavior. 

3.1 Identify individuals in the target groups, 

3.2 Construct a measuring instrument for discovering 
individual perceptions (see Rating Scales, RTS, 
“Page 29,and Questionnaires, QTN, page 19). 

3.3 Administer the measuring instrument (see Inter- 
views, [VW, page 23). 

3.4 Obtain objective measures of individual behavior 
by observation and from past records. 


4. Analyze results. 
4.1 Analyze the responses to determine the percep- 
tions of the organizational climate. 
4.2 Aggregate the responses for each Organization to 
provide a measure of climate for the organization. 
4.3 Compare the measured attributes with the mea- 
sures of behavior to determine which attributes 
significantly affect behavior (see Regression Fore- 
casting, RGF, page 160). 


5. Propose the desired organizational climate. 
5.1 Identify those attributes which seem to signi- 
ficantly affect the desired behavior. 
5.2 Propose an organizational climate which may 
achieve the desired behavior. 


EXAMPLES 


Shukla (1974) interviewed 25 people (faculty, stu- 
dents, staff) in a university department to assess the or- 
ganizational climate. This climate analysis was intended to 
serve as a basis for: 1) changing policies in the department 
by the top management, 2) identifying teaching needs of 
the faculty, and 3) changing organizational attributes and 
practices. Some of the organizational attributes identified 
were decentralized decision making, interpersonal rela- 
tionships, cohesiveness, rewards from teaching, faculty 
workload distribution (research, teaching, and advising), 
flexibility in choice of courses for students, student and 
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faculty Perceptions of inderendent study, decarzmenca] 
goals, and admission requirements, 

Pace (1968) synthesized the results of several climare 
analyses related to the Measurement of college environ. 
ments. Dimensions of the collese climate were scholarshi5 
(e.g., intellectual orientation of students), awareness ‘e.2°, 
self-expression), practicality fe.2., vocational st:dent e2l- 
ture), bureaucracy (e.g., faculty affiliation), and Propriety 
(¢.g., social conformity). These dimensions and their ar. 
tributes were then related to scme2 measure of behavicr, 
e.g., high productivity of scholars, research work. 


THEORY 


The analysis of Organizations encompasses a vartecy of 
disciplines including political science, social Psycaology, 
sociology, public administration, micro-economics, busi- 
ness and management science, and industrial engineering. 
The analytical bias depends largely upon the function of 
the organization. 

Organizational Climate Analysis focuses on identifyins 
the attributes which will enable a diaznosis of problems in 
the organizational environment, and assessing qualitative 
factors with which to measure im provement. The foaus is 
largely on interpersonal factors and the orientation is 


social-psychological. 
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Defining Objectives 


Function Expansion 
Objective Trees 
Intent Structures 


Defining project objectives isa universal imperative of a systems approach. Objectives are 
often unspecified, ill-defined, nonconsensual, and/or time-varying. Three techniques were 
selected which address these characteristics. Two techniques focus on structuring objectives 
in a hierarchy (Objective Trees and Intent Structures). A third tool derives from systems 
engineering and represents a hierarchical view of system function (Function Expansion). All 


three assume that defining objectives is a realizable task. 


Function Expansion 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 


Function expansion identifies the fursction of a system 
endrelatesittoz function hierarchy. 


USES 


Function expansion can be used to: 
1, Generate 2 hierarchy of functions. 
2; Select a necessary function in the hierarchy for 


—~ 


“rich a system is to be designed. 
=: - “¥° ¥ ¥ 
3; Communicate and facilitate understanding of the 
‘ystems function ina hierarchy of syszems. 
+, Create cohesiveness among goup members in mov- 
ig toward a common function and related project goals. 
rovide input to other tools. e.¢.. IDEALS Strategy 


. 


IDL. pege 231}. 


KEY DEFINITIONS 
The Aarcrion is the primary concern of a system, 


the mission of2 project. 
. . | Wie ° 
A $2s2eT isa collection cl components which inter- 
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3) Function hierarchy is an ordering of system func- 
tions from the most specific to the broadest function (see 
figure 1). 

4) The goal of a project is a value judgment which 
satisfies one or more needs. It measures the effectiveness 
of achieving a function. For this tool, a goal is typically to 
minimize costs, maximize profits, or reduce overtime. 


SHORT DESCRIPTION 


A function expansion is a list of transitive action verbs 
which describe the functions of systems. A function 
expansion excludes terms such as ‘make a profit” or 
“minimize costs,” since these are goals or desired measures 
of effectiveness for achieving a function. The function of a 
system describes what a system should achieve; the system 
output describes what form the achievement takes. 

A function hierarchy is created from the function ex- 
pansion list. It corresponds to an expanding perspective on 
the defined scope of a system—each system is part of a 
larger system, and so on (see figure 1). 


ADVANTAGES 


1) Efforts to identify problems with the existing sys- 
tem usually make people defensive and uncooperative. By 
concentrating on the functions of the system being 
analyzed or designed, all people may be effectively in- 


volved. 
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FIGURE1 
Function Hierarchy for Employment System 


Most Unique Specific Function 


1. Provide list of job Opportunities 


2. Communicate job Opportunities 


to unemployed people 


3. Match job specifications with applicant 


specification 


- Get people and jobs together 


5. Find employment for people 


6. Fill vacancies in companies and 


government 


- Have jobs and services carried out 


- Get jobs done 


. Provide services 


- Keep economy functioning 


. Promote general welfare 


Most General Function 


2) Attention to fu nections, rather than goals, facilitates 
alternative idea generation because a goal (as defined 
above) imples an evaluation criteria. Evaluation must be 
deferred when generating ideas (see Brainstorming, BSG, 
Page 3). 

3) Creativity in developing solutions is encouraged by 
knowing all the levels in the hierarchy of functions. The 
decision maker can focus on system function rather than 
on describing uNNECessary Current activities. 


LIMITATIONS 


1) Identifying the real functions of a system may be no 
easier than identifying problems. [t requires insight and 
knowledge about the system. 

2) Systems are often composed of many subsystems, 
each with a variety of functions. Identifying all of them 
can be taxing, Ordering the function €xpansion in a hier- 
archy gives structure or priorities to the functions. There 
may be no agreement on the final order. 

3) Most analysts tend to confuse goals with functions. 
than its function does 


Specifying a system's goal rather 
notreally characterize the system’s 


primary concern. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

A function expansion group exercise must be organized 
and directed. The Nominal Group Technique (NGT, page 
1+) is often used to identify functions or purposes, thouzh 


interac ting groups can be used. 


SKILL LEVEL 

Function expansion group exercises require skill ia 
leadership and experience in group processes. Somecne 
must be able to direct and chaane! the discussions, avoid- 
ing time-consuming digressions about problemsand prob- 


lem identification. 


TIME REQUIRED 

The time required depends upon: 

1) The complexity of the system under study. 

2) Previous Knowledze of the system or similar sys- 
tems, 

Completinga function expansion typically requires !ess 
than a day. In the design process, more time may be re- 
quired to revise the function hierarchy. 


SPECIAL REQUIREMENTS 


A group function expansion exercise is facilitated by 
using a blackboard (or flip chart) and marking pens. Space 
for posting flip chart pages for easy viewing is desirable. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) A regularity is the most frequently occurring (or the 
most important) condition of several characteristics. 

2) Outputs are the desired and the undesired results of 
the transformation Process ofa system. The desired results 
enable the system to achieve its function. 


REQUIRED INPUTS 
Developing a function expansion for a system requires: 
1) Familiarity with system or source of expressed 


need, 
2) Expertise in leading STOUp processes. 
3) Participation of people in the system, users of the 


system results, experts, and decision makers, 


Poem wm oe 


TOOL OUTPUT 

A function expansion produces a list of all possible 
functions of the system, arrangedina hierarchy. This hier- 
archy can be used as an input to the design of systems 
using other methods such as the IDEALS Strategy (IDL, 
page 231). 

The hierarchy provides a greater understanding of the 
svstem under study and its relation to larger systems, of 
which the system may bea component. 


IMPORTANT ASSUMPTIONS 
1) A system is designated as such because it hasa func- 


tion or functions. 

2) Every system is part of a larger system. 

3) Every system may be divided into subsystems or 
components. 

4) A hierarchy of functions corresponds to the hier- 
archy of systems (and subsystems). 

The System Definition Matrix (SDM, page 67) dis- 


cusses these assumptions. 


METHOD OF USE 


GENERAL PROCEDURE 


1. Generate function statements by considering desirable 


outputs. 
1.1 Involve concerned people in generating function 
statements using. for example, a Nominal Group 


Technique (NGT, page 14). The group should be 
heterogeneous, involving clients, workers, deci- 
sion makers, and managers. 

1.2 Define a function statement in the form of a tran- 
sitive action verb and an object. This allows 
members of the project group to readily visualize a 
system's action. Typical functions are: 


Supply services 
Donzte manpower 
Distribute health supplies 


1.3 Avoid verbs which imply the movement of the pre- 
sent condition toward a more desirable state. 
These are more often end goals or objectives, 
rather than the purpose or primary concern. Some 


constructions to avoid are: 


Optimize material usage 
Avoid waste 
Increase machine 


utilization 


Increase profits 
Decrease expenses 
Make money 
Improve productivity 


FUNCTION EXPANSION / 47 


A function statement is the aim or result “that a 
system achieves, or is expected toachieve, with no 
reference to how (who, where, when, etc.) or how 
well (quantities, qualities) the system operates or 
is expected to operate” (Johnson, 1975). 

1.4 Avoid tying multiple functions together with 
words like “and” or “‘in order to.” 

2. Select the most specific primary function of the sys- 

tem. 

2.1 Select the initial specific function from the list of 
possible functions by using a comparison test. Ask 
a question like, “Is the function of the system to 
(function 1) in order to (function 2) or vice- 
versa?’ For example, is the function of the system 
to “irrigate fields” in order to “regulate water 
flow,” or is the function to “regulate water flow” 
in order to “‘irrigate fields’? Clearly “regulate 
water flow” is a function of the more narrowly 
defined system. Similarly, to “irrigate fields” is a 
more specific function of a system to “grow 
crops.” 

Write the selected function at the top of a large 
sheet of paper or flip chart. 


iS) 
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3. Expand the function into a hierarchy. 

3.1 Ask the group, “What is the most immediate or 
direct function of this identified function?” For 
example, the function of the system to “regulate 
water’’ is to “‘irrigate fields.’” Ask the same ques- 
tion for irrigating fields. 

3.2 Repeat step 3.1 until newly identified functions 
are beyond the scope of study. The functions are 
thus arranged in a hierarchy. This process will 
stimulate the creativity of the group and identify 
functions that were not on the original list. 


4. Select the function level on which planning and design 
should concentrate. 
The recommended solution or system resulting from 
such efforts should achieve at least this function. 


Precautions 
1) Do not confuse a goal or end result with a function. 
“Make a profit’’ or ‘decrease poverty’’ are goals, not func- 
P P y g 


tions. 
2) Do not branch away from the main function in an 


attempt to include all possible sub-functions. The func- 
tion expansion will become too unwieldy. The concept of 
regularity helps avoid this pitfall. If the function expan- 
sion is not focussed on the most regular, dominant func- 
tion in the system, then the expansion may go off on tan- 


gential, less important functions. 
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For example, the function expansion fora library may 
develop as shown in figure 2. The functions are arranged 
from the most general to the most specific functions. 


FIGURE 2 
Forecasting the Function Expansion on the 
Most Regularly Occurring Concern 


Circulate Books 


Catalog Books 


A 


Store Books 


——— 


Obtain Books Bind Books 


A 


Order Books 


Order Binding Materials 


3) Do not make big leaps in the function hierarchy. 
The logical flow from specific to more general functions 
must be maintained. It is better to be redundant, e.g., re- 
phrasing a function with slightly different words, than to 
risk being incomplete. 


EXAMPLE 


A function expansion was to be developed for an em- 
ployment service system, the initial step in the design of 
the system. The functions generated in the first step are 
listed in figure 3. Some were identified as goals rather than 
functions and were not considered further, 


FIGURE 3 


Function Expansion List for Employment Service 


1) Get people and jobs together 
2) Find employment for people 
3) Reduce unemployment 
4) Determine available jobs 
5) Determine client job skills 
6) Increase employment 
7) Aid job-seekers 
8) Fill vacancies in companies and govern- 
ment 
9) Communicate job Opportunities to un- 
employed people 
10) Match job specifications with applicant 
qualification. 
11) Provide statistics about unemployment 
Goal —3— 12) Act as a “thermometer” for job needs 
to advise future careers to students 


Goll > 


Goll >> 


The most specific function was identified as “‘to oto 
vide list of job opportuaizes.” The function hierarchy was 
then developed using some of the other functions (see 


figure 1). 
This example is continued in IDEALS Strategy (IDL, 


page 231). 


THEORY 


Function expansion is based on the fundamental char- 
acteristic of a system: its function (Nadler, 1967). A sys- 
tem is a collection of elements and dimensions which 
interact to achieve acommen function (see System Derini- 


ton Matrix, SDM, page 67%. 


Starting with the basic Dremise that a system is desic 


Ct 
nated as such because it achieves an identiiiable function, 
functions can be identified fora hierarchy of systems. The 
principle of system hierarchy has two parts: 


1) Every system is part of a larger system. 
2) Every system can be divided into subsystems or 


componen ts. 


Since each system ina hierarchy of systems hasa function, 
the hierarchy of functions corresponds to the hierarchy of 
systems. The function hierarchy begins with the most 
specific primary function and extends to the ultimate, 
more general function of the largest system of interest 
(region, state, nation, world, etc.); 

Many of these ideas about systems and systems descrip- 
tions draw upon the body of knowledge identified as 
General Systems Theory. 

The effectiveness of the group exercise has been sup- 
ported by empirical research into design strategies (Nutt, 


1974), 
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Objective Trees 


PREREQUISITE TOOLS 

ets. 
LSAGE 
PURPOSE 

ti: otiective tree technique helps to define project 
ook i522 22d provides a way to order them ina hierarchi- 
Saree estore 
LSes 

fq 22'st=ze tree is used to; oe 


> Fr2vi22 a guiding rationale for systems design and 


2 incizz:e how the attzinment of sub-objectives con- 

sifutes 12 the accomplishment of higher level objectives. 
= $22% Zow objectives for a project are interrelated. 
= lienicy criteria for evaluating alternative means. 
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7: zss2ss the level of impact or scope of a project. 
reswse necessary inputs to other techniques, such 


&i bers Framework (LGF. page 260) and Planning, Pro- 
Pc. 2c = budgeting (PPR, page O30): 


KEY DEFINITIONS 


i An clvecrive is a specific statement of purpose ex- 
ors kt Gecired end. The usual forms: 
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Infinitive + Object + Qualifying Phrases 
(see figure 1) 


2) A tree graph is a set of linked elements where only 
one link exists between any two factors (see Tree Dia- 
grams, TRD, page 74). The elements in an objective tree 
are the objective statements or phrases (see figure 1). 

3) Means-ends analysis is the identification of alterna- 
tive actions to achieve specified ends. 


SHORT DESCRIPTION 

Objective trees may be constructed to aid project de- 
sign and evaluation. An objective tree consists of Project 
objectives linked hierarchically in a tree graph; objectives 
at a lower level contribute to the attainment of an objec- 
tive at a higher level (see figure 1). The objectives which 
are measured to indicate the success of a project are usu- 


ally found at the lowest level. 
Objective trees are one of the many forms of tree dia- 


grams (TRD, page 74) and are closely related to means- 


ends analysis. 


ADVANTAGES 

1) The objective tree allows a rigorous development of 
explicit and comprehensive objectives. This helps the de- 
sign or implementation of a project to achieve the desired 


ends. 
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FIGURE 1 
An Example of a Partial Objective Tree Developed fora Hydro-Electric Project 


Promote Regional Welfare 


Increase Employment 


Provide Jobs 


Increase Food Production 


Promote 
Navigation 
Promote Industry Conro] 
Provide Jobs Flecdi-- 
in Agriculture 
Pov bes 
mre Irrigation 
TIME REQUIRED 


2) Since the objectives are made explicit, the diagram 
is useful to communicate the relationship between objec- 
tives to other decision makers and interested groups. 

3) Objective trees may incorporate both quantitative 
and qualitative objectives. Qualitative objectives may be 
expressed at alower level of the hierarchy. 

4) The process of developing the tree often indicates 
interlinking or related objectives which might not other- 


wise be considered. 


LIMITATIONS 


1) No single objective tree is valid fora particular proj- 
ect. Each person will construct an objective tree ina differ- 
ent manner. There is inherent uncertainty and ambiguity 
in specifying objectives, 

2) The stated and the actual objectives of personnel in 
an organization may differ significantly, Determining 
actual objectives is a difficult (if not impossible) task. 

3) There may be confusion over means vs. ends. An ob- 
jective tree structures the statement of goals (or ends) by 
identifying sub-objective (means) to their attainment. 


REQUIRED RESOURCES 


SKILL LEVEL 


Strong interpersonal skills are useful to successfully ob- 
fain the appropriate information for constructing an ob- 
jective tree. The ability to logically decompose objectives 


LS Necessary. 


The time required depends on the ambiguity and un- 
certainty of the objectives and the level of detail desired 
for the objective tree. A tree may be constructed within a 
few hours or over several days, depending on the scope of 
the project and the clarity of objectives. 


SPECIAL REQUIREMENTS 
Index cards (or any small uniform blank card) are use- 
ful for laying out objectives ina hierarchy, 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


The following definitions are illustrated in figure 2: 

1) A quantitative objective represents a quannfiably 
verifiable end or result. 

2) A binary-event objective either clearly occurs or 
does not occur. 

3) Qualitative objectives are Judged subjectively to 
determine if they have been accomplished. 

4) A deterministic measurement of an objective is 
wheré the realization of the objective is unequivocally 
determined from numerical data. 

3) A probabilistic measurement of an objective occurs 
when the attainment of the objective may not be deter. 
mined with certainty, e.g., because of variability of the 
data. 


6) A logical measurement determines whether a bi- 
nary-event objective has or has not occurred. 

7) An axiological measurement involves value judg- 
ments, where the data necessary to determine accomplish- 
ment of an objective are gathered via subjective methods, 
c.g., Interviews (IVW, page 23) or surveys (SVY, page 36). 


REQUIRED INPUTS 


One step in designing an objective tree involves classify- 
ing the types of objectives. Warfield and Hill (1972) classi- 
fy objectives according to whether they are quantitative, 
binary-event, or qualitative, as well as by the method used 
to measure the attainment of the objectives. These classifi- 
cations are shown with examples in figure 2. 

A quantitative objective may be measured either by 
deterministic or probabilistic methods. A deterministic 
measurement is made when definite attainment of an ob- 
jective is determined from numerical data. 

A probabilistic measurement is made when the col- 
lected data are insufficient to determine with certainty 
that an objective has been attzined. This is the case when 
data are collected on only a sample of the target popula- 
tion ‘see Surveys, SVY, page 36). 

A binary-event objective clearly occurs or does not 
occur. Logical measurement is used as a basis for deter- 
mining whether a binary-event objective has occurred. 

Qualitative objectives are those judged subjectively to 
decide if they have been attained. Axiological measure- 
ment, Or measurement which is judgmental yet more or 
less evident, may be accomplished through interviews 


I\W, page 23) or surveys (SVY, page 36). 


TOOL OUTPUT 


The output will be an objective tree which identifies 
and links objectives (see figure 1). This is essential for 
other tools, e.g., Intent Structure (INS, page 55) and Plan- 
ning, Programming, and Budgeting (PPB, page 236). 
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IsSPORTANT ASSUMPTIONS 

The major assumption underlying the objective tree is 
tne hierarchical relation between objectives. The objec- 
tives for 2 project may be uncertain or ambiguous because 
in¢y Rave not been articulated by the interested parties, 
and because goals are not constant over time. The objec- 
rive tee technique assumes that the objectives higher in 
ee are less variable over time, and that they are shared 
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FIGURE 2 
Examples of Quantitative, Binary-Event and Qualitative 
Objectives Classified by Methods of Measurement 


Quantitative Objectives 


Deterministic Measurement 

1. To achieve annual sales of at least $150,000,000 

2. To build 150 low-income houses 

3. To ship 500 units of the product 

4. To increase the school’s teacher-student ratio to 40 
per 1000 

5. To obtain charitable contributions exceeding 
$100,000. 


Probabilistic Measurement 

1. Toachieve a TV viewing of at least 10 million 

2. To produce the product with no more than 1% de- 
fective 

3. To persuade at least 90% of the drivers to wear seat 
belts 

4. Toreduce the crime rate by 50% 

. To increase life expectancy by 10 years. 


Binary-Event Objectives 


Logical Measurement 

To land the plane safely 

To find the lost ship 

To acquire the new subsidiary 

To complete construction of the hospital 

To land a robot on Mars and bring it back safely in 


this century. 


mh & ro we 


Qualitative Objectives 


Axiological Measurement 
1. To improve the appearance of the product 
2. To provide a pleasant and comfortable ride for pas- 


sengers 
3. To improve the health of the citizens 
4. To build a beautiful library 
. To improve employee morale. 


NOTE: Reprinted from A Unified Systems Engineering Concept 
by John N. Warfield and J. Douglas Hill by permission of Battelle 
Memorial Institute. Copyright (c) 1972 by the Battelle Memorial 


Institute. 


technique. Its validity does not affect the use of the objec- 
tive tree to explicitly reveal goals and ends, whether they 


are measurable or not. 


METHOD OF USE 
GENERAL PROCEDURE 


When beginning the construction of an objective tree, 
one should not strive for perfection. Initially, getting 
started is important, for the interaction between objec- 
tives cannot become apparent until an initial framework 
or tree has been constructed. As the tree evolves, one 
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begins to consider more carefully and refine the tree. 
Based on the work of Warfield and Hill (1972), the follow- 


ing steps are recommended. 


y R 


Ww 


Generate an initial list of objectives. 

1.1 Define the problem area. 

1.2 Identify the people who will be involved in design- 
ing or directing the project. 

Elicit their project-related objectives. 

Identify as many project objectives as possible, 
without attempting to structure the objectives. 


ia 
1.4 


. Identify an overall objective. 


2.1 Identify an overall objective for the project, to 
which all other objectives will relate. This objec- 
tive will reflect a value judgment, and it will need 
axiological measurement. Examples of such objec- 
tives are: “to meet the needs of the community” 
or “to achieve equality in housing benefits.” 

This objective is positioned at the first level of the 
tree, i.e.,at the top of the tree. All other objectives 
will be positioned below it. 


2.2 


. Extend the cree one level down. 


3.1 Select objectives for the next level down from the 
list generated in step 1, or generate additional ob- 
Jectives by asking “what are the sub-objectives 
necessary to accomplish these objectives?” This is 
the branching rule for this type of tree diagram 
(see Tree Diagrams, TRD, page 74). 

3.2 Draw lines on the tree to connect these lower level 
objectives to the objective they help achieve. 


. Extend the tree to the next lowest level. 


4.1 Choose one of the objectives listed at the current 
lowest level of the tree. Identify the sub- 
objective(s) which help to achieve it. 

4.2 Repeat step 3 for all other objectives at the level 
most recently constructed. Another level of objec- 
tives results when all the objectives in this level are 
dealt with. 


Review the tree. 
5.1 Review the tree constructed so far. [t may be 
found that: 
a) Some objectives are missing; 
b) An intermediate level of objectives may be 
added; 
c) It is possible to extend the tree upwards from 
the first (top) level; or 
d) An objective at a level is seen to achieve more 
than one objective at some higher level. In this 
case, redefinition of the objectives is necessary. 


5.2 If the tree appears complete, go to step 6. Other- 


wise, return to step 4, 


6. Check the measurability of lowest level objectives. 

6.1 Take an objective at the lowest level of the objec- 
tive tree. Ask the question: Is this objective mea- 
surable? This is the stopping cule for the tree dia- 
gram. The measurability of an objective desends 


on two processes: 


a) The selection of a measure or unit by which the 
attainment of objectives will be assessed. (This 
measure or unit should be objectively verifi- 

«- able.) 

b) The design of a measurement scale and data 
collection process, to aid in de termining the de- 
gree to which an objective may be reached ‘see 


Rating Scales, RTS, page 29). 


2 Generally the objectives at the lowest level will be 
quantitative or binary-event. Quantitative objec- 
tives generally have a numerical threshold to indi- 
cate what performance is acceptable. 

If the lowest level objective is not measurable, 
then extend the objective down one more level, 


6.3 


1.€., return to step 4. 
Repeat step 5 for each of the lowest level objec- 


tives. 


6.4 


EXAMPLE 


The government of Temasek was considering the con- 
struction of a large hydro-electric power project for Mek 
River Valley. The dam would form a large reservoir with 
uses other than driving the power plant turbines. In order 
to understand the alternative objectives of such a large- 
scale project, the Minister of Planning asked his staff to 
develop an objective tree. 


Generating an Initial List of Objectives 

The staff identified the problem: provide energy for 
the growth of the region and country. They assembled a 
group of industrial leaders, merchants, farmers, and 
laborers from the region. The Nominal Group Technique 
(NGT, page 14) was used to identify a list of objectives: 
provide energy, permit irrigation, promote navigation, 
control flooding, and promote the welfare of the region. 


Identifying an Overall Objective 
The group discussed the list and selected the last item as 
the overall objective. This was the top of the tree. Pro 
moting the region’s welfare requires a value judgment 
since it is not directly measurable. Yet the group shared 
the view that this was a worthwhile goal. 


s9anyzaf{qo parry ————— 


9923 2anra{qo ur odequy Arewug ——__..___. 


JIA aepndry 


$987) 19420 30, Aaysnpuy Aaeayy 10] 
Ay19121921q 2ptaosy Auoun29]q opiaosg 
N“ ae 
laa 4 
x ae 
SPAIEH Ysty “y 
pe. 2h apiaoig Pe. ASiauq 
es : sduing a *PreOrd 
> uonedsiaay uny 
S Buissoo01y9 or 
WIeld Pooy4 ysty Ps aanynoudy ur 
aie’ piv" wee ae aroworgy apuoly wore dias $4°f apiaory Axsnpuy niowosy 
ea = wud Yy = 
Ausnpuy Oo Tee ee ol 
Burysiy aMyNwy ~~ Sqof apiaoig 
a10wolg daIsUd UT I[Qeuy 


opery oseasou 
duipooy.z jouos = | ae a ] 


YONINPOIG pooy asvouou 
: d Pooy 


duauIAG dur) sv oaouy 
2J!"] Jo sso-] oars PI4IIWIWO?) NOWOIY 


: ss gh Fs 2 ok eee 


— 
za! NPA PUI .y Nowosy ll 
od ae 


na 
ag ee 
= _— 
~~ 
Vineet Se 


JIU PAY ["Uoneny NOU 


Wofo1g 914399] q-O1pAqy v s0) padojaaaq IATL VANDI GC) Ue yo aduue 


Xsp uy 
€dUNSIA 


54 / DEFINING OBJECTIVES 


Extending the Tree 
to Lower Levels 

The remaining objectives were positioned in the 
branches of an objective tree (see figure 1). Then addi- 
tional objectives were identified, including a higher objec- 
tive: promote national welfare (see figure 3). This_ae- 
knowledged that saving lives, increasing employment, and 
promoting commerce serve higher objectives than those of 
the region. 

One technique for facilitating the construction of the 
rest of the tree is to list each objective on a separate index 
card. The index cards may then be laid out ona table to 
determine their hierarchical relationships. Additional ob- 


Jectives are inserted as needed. 


Checking the Measurab ity 
of Lowest Level Objectives 

The objective tree exercise was completed by consider- 
ing the measurability of each end of the branches. For 
example, running irrigation pumps and harvesting fish can 
be measured quantitatively. However, the transformation 
of the flood plain is a qualitative objective and must be 
broken down further in order to identify quantitative 
measures (e.g., increase in double cropping brought about 
by farmers who no longer risk flood damage). 

Several objectives achieve more than one higher level 
objective (e.g., providing electricity and regulating water). 
The staff decided to show the interconnection with 
broken lines rather than redefining objectives, though the 
latter may be preferred. Regulating water for irrigation 
may be at cross-purposes, and the objective tree should re- 
veal this to planners. 

This latter point illustrates how the objective tree 
might be used to influence the scope of the project. The 
decision makers must decide at which level in the set of 
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objectives the project will be addressed. This in part deter- 
mines the breadth of of the project, e.z., is the hydro- 
electric project to address the irrigator’s needs as well as 
the demand for cheap electric power? 

This example is developed further in Intent Structures 


(INS, page 55). 


THEORY 


The structure of objective trees derives from the theory 
of graphs and networks (Warfield, 1973). The identifica- 
tion and measurement of the attainment of objectives is 
rooted in worth assessment and value theory. See, for 
exam ple, DeNeufville and Stafford (1971). 

Interaction matrix diagrams ‘IMD, page 92) may show 
the relationships among the multiole objectives. The 
correspondence between a matrix representation and a 
tree diagram makes the joint use of the techniques a logical 


extension of objective trees. 
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Intent Structures 


PREREQUISITE TOOLS 
Objective Trees (OBT, page 49). 


USAGE 
PURPOSE 


An intent structure defines objectives, identifies the 
Ou'rzers associated with each objective, and describes the 


logical relationships among the objectives. 


USES 

An intent structure is used in the same manner as an 
objective tree (see OBT, page 49). In addition, an intent 
sucture: 

1} Distinguishes objectives held by various interest 
Soups. 

2} Reveals possible conflicts among sub-objectives. 

3; Defines alternative objectives in a logically con- 


sistent framework. 


KEY DEFINITIONS 

1) An oumer is one or more organizations or persons 
who possess intent for, or have vested interest in, a 
proies:. For example, the Ministry of Agriculture’s 
crime obiective is the increase of food production; the 
fermer has an interest in higher farmgate prices. 


2) A logic element is a symbol indicating the nature 
of the relationship between two or more objectives at 


adjacent levels in a hierarchy. 


SHORT DESCRIPTION 


Objectives for various interest groups, or owners, are 
defined and arranged hierarchically so that any objective 
is achieved only if the specified sub-objectives are 
realized (see figure 1). The owner(s) of each objective is 
identified on the diagram. 

An intent structure may also show the relation among 
objectives at different levels by connecting logic ele- 
ments (see figure 2). These specify three possible 
connections: whether all, any, or only one of the 
sub-objectives must be achieved in order to attain the 
higher level objective. 

An objective tree is simply an intent structure for 
which all sub-objectives must be realized, and in which 
the owner of each objective is not designated. Warfield 
(1973) developed the intent structure to correct defi- 
ciencies in the simple objective tree approach. 


ADVANTAGES 

An intent structure defines the relationships between 
objectives so that the analyst is encouraged to think 
about the various interest groups. Conse ‘ently, the 
intent structure may be employed to clarify thinking, to 
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FIGURE 1 
Format for Intent Structure 


OWNER A- OWNER B 


OBJECTIVE 1 OBJECTIVE 2 


LOGIC 


ELEMENT 


OBJECTIVE 3 OBJECTIVE 4 OBJECTIVES 


FIGURE 2 


Logic Elements for Intent Structures 


Symbol | bee Aimee 9d Sasi For the achievement of the higher level objective: 
a 


All sub-objectives are necessary 


AND 


And 
ot | tata 


Any one or combination of sub-objectives must be attained 


Any one, but only one sub-objective must be attained 
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indoctrinate new personnel, and to identify possible 
conflicts in objectives. 

The logical elements give the analyst the option of 
describing alternative and interacting objectives, and a 
means to examine the consistency of relationships. 

As the project evolves, the intent structure can be 


easily modified to incorporate new directions. 


LIMITATIONS 


There is no single intent structure which is valid for a 
particular Project since people will construct an intent 
structure differently. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

The primary task is to identify objectives and 
associated owners. Representatives of concerned interest 
groups should be identified for this purpose. The 
secondary task is to arrange the objectives in an intent 
structure which reflects the interrelationships of goals. 


SRILL LEVEL 


In addition to the interpersonal skills necessary to 
elicit objectives from possibly disparate sources, the 
analyst must be able to logically sort out the objectives 
and fill in the missing or unstated sub-objectives. There 
is no substitute for practice; however, skill at construct- 
ing simple objective trees ‘OBT. page 49) and function 
expansions :FEX, page 45) is useful. 


TIME REQUIRED = 

If a group discussion technique, e.g., Nominal Group 
Technique (NGT, page 14} is used to generate objectives, 
about half a day will be necessery. This does not include 
the time required to assemble the group. Actual construc- 
tion of the intent srructure should take an additional two 
to four days, depending on the scope of the project and 


the number of owners involved. 


SPECIAL REQUIREMENTS 

The method of construction given in the following 
sections requires smal] (3" x 5") cards and tape. Warfield 
1973; hes developed computer programs for the same 


p-"FoOSs?. 
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DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) The AND logic element links sub-objectives to 
objectives where all sub-objectives must be achieved in 
order to attain the higher level objective(s) (see figure 3). 

2) The OR logic element links objectives where the 
attainment of any one or a combination of sub- 
objectives will achieve the higher level objective (see 
figure 4). 

3) The XOR logic element links mutually exclusive 
sub-objectives to the higher level objective(s) (see figure 
5). One sub-objective alone achieves the higher level 
objective. Usually the sub-objectives are mutually exclu- 
sive only if they are incompatible, or if they compete for 
the same limited resources. 


REQUIRED INPUTS 

The intent structure utilizes the input of several 
people, directly or indirectly associated with the project, 
to generate the list of objectives. These people and 
Organizational representatives may also be involved in 
reviewing the finished structure and in modifying it to 
better reflect their interests relative to the other owners. 


TOOL OUTPUT 

The most general type of intent structure incor- 
porates both owners and logic elements in a hierarchical 
structure of objectives (see figure 1). Three modifica- 


tions are commonly used: 
1) The Owner-Free Intent Structure is normally used 


when the owner is the same throughout the structure, 
making it unnecessary to list the owner with the 
objectives. 

2) The Logic-Free Intent Structure (or Objective 
Graph) omits the logic elements from the intent struc- 
ture. Deletion of the logic may make the intent structure 
less confusing in some cases, and thus easier to read. 

3) The Objective Tree (OBT, page 49) isa special kind 
of Objective Graph in which the structure of the graphisa 
ree diagram (TRD, page 74). 


IMPORTANT ASSUMPTIONS 

Intent structures correct some of the deficiencies 
which occur when trying to represent complex project 
objectives as a simple objective tree (see OBT, page 49). 
However, similar assumptions must hold, i.e., the objec- 
tives are discernable and the objectives have some degree 
of constancy over time. The problem of consensus 


FIGURE 3 
Use of AND Logic Element 


Ministries of Health, Agriculture 


Reduce Starvation for Poor 


Ministry of Agriculture 


Provide Sufficient Food 


Provide Nutritional Diet 


Ministry of Health 


FIGURE 4 
Use of OR Logic Element 


Educators, Ministry of Education 


Educate Populace 


School Administration Private and Volunteer Groups 


Strengthen Formal Education Develop Non-Formal Education 


FIGURE 5 
Use of the Exclusive OR (XOR) Logic Element 


a) Mutually Exclusive Objectives (Means) for Reducing Birthrate 


Ministry of Health, Donor Agencies 
Reduce Birthrate 


XOR 


Donor Agency Ministry of Health Religious Groups 
Provide Contraceptives Provide Sterilization Clinics Promote Rhythm Method 


b) Conflicting Objectives for the Use of Reservoir Water 


Government, Populace of Region 


Promote Regional Development 


XOR 


Provide Energy for Industry 


Industrial Sector, Government Farmers, Government 


Release Water for 
Hy dro-Electnc Turbines 


Industrialists, Stockholders Farmers, Extension Agents 


60 / DEFINING OBJECTIVES 


among the various entities associated with the objectives 
is explicitly treated by identifying owners, assuming that 


the correct owners can be found. 


METHOD OF USE 
GENERAL PROCEDURE 


Intent structures may be constructed by a procedure 
similar to the way objective trees (OBT, page 49) are devel- 
oped (Warfield, 1973). 


1. Generate a list of objectives. 

1.1 Identify the owners and owner representatives 
who have an interest in the project. 

1.2 Generate as many objectives as possible. Make no 
attempt to structure the objectives. Brain- 
storming (BSG, page 3) or Delphi (DLP, page 168) 
may be used to elicit the Opinions of the owners/ 


representatives. 


2. Construct an intent Structure, 

2.1 Write each Objective on Separate cards and 
indicate its owner(s). 

2.2 Lay the cards on a flat surface. Begin arranging 
them in an intent structure. Note: 

a) If objective A must be accomplished in order 
fo accomplish objective B, A lies below B in 
the structure. 

b) If accomplishment of objective C, either 
separately or in combination with other 
objectives, represents an alternative way of 
accomplishing objective D, C lies below D in 
the structure, 

2.3 In arranging the cards, begin with any objective 
level. ft is not necessary to begin with the 
objective at the top of the structure. __ 

2.4 If, in the process of arranging the objectives, some 
objectives are missing or are irrelevant, then add 
new objectives or discard them. 

2.5 Once a suitable arrangement has evolved, tape 
the cards toa large sheet of Paper. 

2.6 Review the intent Structure to see if the arrange- 
ment is logical, 


3. Incorporate the logic elements (optional), 
3.1 Introduce the logic elements into the intent 


attain each objective higher in the structure. 


3.2 Re-examine the owners asscciated with each 
objective in light of the logical links berween 
sub-objectives. 

If necessary, redraw the diazram for distribution 
to others (e.g, representatives of ‘“towner”’ orza- 
nizations). Include a simple key for the logical 
elements (see figure 2). 


3.3 


EXAMPLE 

An objective tree was developed for a hydro-electric 
reservoir project (see OBT, tigure 3, page 53). The Gdjec- 
tives fot- the Project included generating energy, cer. 
mitting irrigation, promoring the fishing industry and nav- 
igation, and Saving lives and damaze carsezh floed can- 
trol. 

An intent structure was prepared which expands onthe 
Original objective tree (see figure 6). It included some of 
the owners of the objectives and the logic elements re- 
lating the sub-objectives to higher level objectives. The 
owners of each of these objectives could be identified in 
most cases, e.g., farmers desiring urigation, shippers want- 
ing navigation facilitated, the government and citizens 
wanting jobs. 

All the higher level objectives werebrought together 
under the objective “PROMOTE THE REGIONAL 
WELFARE” through the logical “OR” relation. Re- 
gional welfare is Promoted by achieving any one or more 
of the sub-objectives, However, one might argue that the 
logic element should be an “exclusive OR” (XOR) 
because sub-objectives are conflicting. For example, 
releasing water for irrigation may be completely counter 
to providing a uniform flow for turbines. The competi- 
tion between certain sub-objectives can be shown on the 
intent structure using the logic elements which connect 


the objectives, 


THEORY 


Intent structures have been developed by Warfield 
(March, 1973a), supported by the Battelle Memorial Insti- 
tute, 


1970. Warfield’s intent structure reveals ways to build 
on a committee planning approach “‘as well as some of 
the weaknesses of its [the committee's) product” (page 
8-1). In Particular, Warfield examines the logic and 
consistency of the relations among the stated objectives, 


This application of the technique emphasizes the 
utility of the intent structure as a basis for logical 
analysis of project purposes and goals. The logical 
relationships between objectives permit the structuring 
process to be automated ona computer (Warfield, March 
1973b). Then, through computer manipulations, the 
hierarchical relationships are constructed by synthesizing 
the simple subjective judgments of the relationship 
between each two objectives. These latter judgments are 
still the domain of humans, as is the identification of 
objectives. These points are explored further in Inter- 
action Matrix Diagramming (IMD, page 92). 
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FIGURE 6 
Intent Structure for Hydro-Electric Reservoir Project 


Increase Employinene Government Farmers, Citizens 


OR 


Governmene. Citizens 


Rural Population 


Promote Cottage Indus:rics 


Indu strialises. Seoc hholders 


AND 


Run Irrigation Purnps 


Farmers, Fish Processors, Citiz ens 
Generate Electricity for Rural Use 


Incuiserialises, Stockholders 


Generate Electricicy Yor Industry 


Governinene, Industrislises. Farmers. Citizens 


Generate Ener 


sy. Electric Power 


Provide Uniform Fiow for Hydroturbines 


' 


Promote National Welfare 


Promote Regional Welfarc 


Promote Fishing Industes 


Fishormen 


Frovide Fizt danes: 


Bus'nessmen. Government 


Promote Commerce 


Shippers. Businessmen 


Increase Trade 


Sk:opers. Fishermen 


Promote Navicsetion 


Government, Rural Population 
Save Loss of Life 


Government, Rural Pepulation 
Transform Flood Plain 


Prevent Crop Damage 


Government, Citizens, Farmers 


Conrrol Flooding 


Government, Citizens, Farmers 


Maintain Low Water Level for Emergencies 


Shippers. Fishermen 


Maintain, High Water Level 


Maintain Constant Water Level 


[V 
Describing Complex 
Relationships 


System Definition Matrix 
Tree Diagrams 
Oval Diagramming 
Interaction Matrix Diagramming 


A system is a collection of components which interacts to achieve a specific function or 
purpose. This versatile concept permits the analyst to describe the problem and prescribe a 
solution (System Definition Matrix). Identifying the salient variables and describing the rela- 
tionships among them is a necessary ingredient in the systems approach. Each of the tools in 
this section approaches this problem in slightly different ways. Hierarchical relationships 
(Tree Diagramming), causal loops and feedback relationships (Oval Diagrams), and cross- 
interaction relationships (interaction Matrix Diagrams} present approaches to structuring 
complex relationships. These techniques rely primarily on visual representations to define 
the system and are linked by a common example. The problems of nomad pastoralists are 
described as a system of ecological, economic, and social-cultural variables and relationships. 


System Definition Matrix 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 

The System Definition Matrix is a prescriptive model 
for identifying the conditions and details that need to be 
specified in developing a plan or design. It is also a descrip- 
tive model for understanding and specifying the com- 
ponents of a system and the interrelationships of the com- 
ponents to the system function and environment. 


USES 

The System Definition Matrix may be usedas: 

1A comprehensive means for identify ing and model- 
ing the essential components of a system in order to com- 
municete and to help understand the system’s function in 


its environment. 
2) A checklist to guide information-gathering for de- 


sign or analysis. 
3; A format for specifying details of a system design. 


KEY DEFINITIONS 
1) A descriptive modelis arepresentation or imaginary 
entity containing information in a predefined form, in- 


tended to be interpreted by its user rules (Thesen, 1973). 

2) Components are the entities in a system which may 
be elemental, or they may be subsystems having distinct 
components. 

3) A system isa collection of components which inter- 
act to achieve acommon function. 

4) The function is the primary concern of the system. 
It is the fundamental dimension of purpose. Note that 
functions are not the goals, or the desired results, of the 
system. This distinction is further clarified in Function 
Expansion (FEX, page 45). 

5) A checklist is used in design or analysis where items 
are marked or otherwise noted item by item. 


SHORT DESCRIPTION 

The System Definition Matrix has eight elements (rows 
of the matrix): purpose, mput, output, sequence, environ- 
ment, physical catalysts, human agents, and information 


catalysts. 
Each of the system elements can be descnbed in five 


dimensions (columns of the matrix): fundamental, rate, 


control, interface, and state dimensions. 
The specification of elements by these dimensions 


composes the System Definition Matrix (see figure 1). 


ADVANTAGES 
1) The System Definition Matrix enables clear separa- 
tion and identification of the interrelationships among 
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components of a system in order to characterize the 
system structure. oe 

2) It provides a more detailed model than that found 
in Logical Framework (LGF, page 260). 

3) Specifying rate, control, and state dimensions re- 
quires a dynamic view of the system. This explicit treat- 
ment of time facilitates planning and project control. 

4) Simply specifying the fundamental aspects of each 
element can be advantageous, e.g., the breakdown of the 
system may be used in other tools (for example, Scenarios, 
SCN, page 164, and Computer Simulation Models, CSM, 
page 129). 

5) Complex systems can be structured by treating each 
row, column, or cell as a System Definition Matrix. This 
can be extended as far as necessary to handle the com- 


plexities. 


LIMITATIONS 


1) A somewhat mechanistic approach (input > se- 
quence > output) may not be palatable to project 
personnel. Describing a project in a matrix may be alien 
to their way of thinking. Other techniques for character- 
izing system structure (see Section IV tools) may avoid 
this. 

2) A System Definition Matrix is seldom completely 
specified since components may not be identifiable, or 
their specification may not be relevant to the description. 
Confusion may arise over where a system component be- 


longs in the matrix. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


Considerable effort is required to completely specify 
Sve dimensions for each of the eight elements, particularly 
since entries in the matrix may be hard to define. How- 
ever, simply completing the fundamental dimension re- 


quires the least effort and may give the greatest return. 


SKILL LEVEL 

Identifying or specifying matrix entries requires a 
thorough understanding of each entry in the matrix. 
Working through examples of familiar systems and com- 
pering them with similar efforts will provide confidence in 
developing System Definition Matrices. Function expan- 
son FEX, page 45) is useful in developing relevant skills. 


TIME REQUIRED 
proportional to the com- 


The time reguired is directly Pp 
eyiey of the svstem and the degree of matrix complete- 


- 
s 
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ness desired. For design problems, the degree of creativity 
one is able to exercise in specifying entries influences the 


time. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) The environment is the set of all factors which are 
salient to the understanding of systems relationships, but 
which are outside the influence of the system variables. 

2) Inputs are the people, information, and/or physical 
items which enter the system to be transformed by a se- | 
quence into outputs of the system, €.g-, the raw materials 
of the project. 

3) Outputs are the desired and undesired results of the 
transformation process of a system. The desired results en- 
able the system to achieve its function. Patients leaving a 
hospital, cured or not, are outputs of a hospital system. 

4) A sequence is the process by which the inputs are 
worked on, transformed, or processed into outputs, usu- 
ally with the aid of catalysts, e.g., the steps in diagnosing, 
treating, and curing a patient. 

5) Physical catalysts are the equipment, facilities, etc. 
which are necessary for the inputs to be transformed into 
outputs, but which are not themselves inputs or outputs of 
the system. 

6) Human agents are the personnel who may be neces- 
sary for the system to achieve its function, yet are not 
themselves inputs or outputs of the system, €.g., medical 
staff for a hospital system. 

7) Information catalysts are the communication (wnt- 
ten or verbal) and the knowledge which enable the system 
process to occur, yet which are not inputs or outputs of 
the system, e.g., staffing assignments at a hospital. 

8) A fundamental dimension is the basic charactenstic 
of the eight system elements. The hospital building is the 
fundamental dimension of the physical catalyst element 
of the hospital system. 

9) The rate dimension is the performance measure for 
a system element. For example, a hospital system may 
have as its input 50 new cases per day; the rate dimension 
of output may be 40 releases per week. 

10) The control dimension evaluates and regulates any 
element's specification, e.g., more than two mortalities 
per week (rate dimension of output) in a surgery unit may 
result in corrective action (control dimension) by the 
Hospital Review Committee. This dimension measures 
each element as the system operates, compares the mea- 
sure to what is designed or desired, and takes action if the 
difference is greater than desired. 

11) Interface dimension is the relation to other sys 


tems or elements—a linking entry to related System Defi- 


Function 


Fundamental Dimension: 
Rate Dimension: 
Control Dimension: 
Interface Dimension: 


Future State Dimension: 


Input 


Fundamental Dimension: 
Rate Dimension: 
Control Ditnension: 
Interface Dimension: 


Future State Dimension: 


Output 


Fundamental Dimension: 
Rate Dimension: 
Control Dimension: 
Interface Dimension: 


Future State Dimension: 


Sequence 


Fundamental Dimension: 
Rate Dimension: 
Control Dimension: 


Interface Dimension: 


Future State Dimension: 


FIGURE 2 
System Definition Matrix in List Format for Alcoholics Treatment Center 


Treat alcoholics 


Reduce alcoholism 
County department of health review 


Disease treatment 


Treatment centers expand to meet rising demand 


Clients 

Approximately ten per day 

Check that no more than two tumed away per month 
Client identification, clean bedding from laundry system 


In five years may take drug referrals, eliminate repeaters . 


Detoxified clients 

100 percent release 

Check for subsequent referral 
None 


Not specified 


Sign in, cor.tact relative, detain, examine, release 
Detain 24 hours, notify relatives within 2 hours 
Check that no clients detained more than 48 hours 
Physical examination sy stem 


Not specified 


FIGURE 2 
Continued 


Environment 


Fundamental Dimension: Social: unsupported, political, decriminalized 


treatment, physical: pleasant surroundings 


Rate Dimension: N.A. 
Atmosphere should not condone behavior, no coddling 


Control Dimension: 
Interface Dimension: Not specified 


Future State Dimension: Not specified 


Phy sical Catalysts 


Fundamental Dimension: Beds, toilets, hot coffee 
Ten beds available per night 


Check for clean bedding 
Laundry system for bedding 


Rate Dimension: 


Control Dimension: 


Interface Dimension: 


Future State Dimension: Not specified 


Human Agents 


Social worker, family counselor (police), physicians aid 


Fundamental Dimension: 


24-hour staff on hand 


Rate Dimension: 


Control Dimension: Shift staff to maximum use hours 


Police referral, Alcoholics Anonymous 


Interface Dimension: 


Future State Dimension: Not specified 


Information Catalysts 


Admission and release forms, client identification 


Fundamental Dimension: 
N.A. 
Four weeks supply of forms on hand as safety stock 


Rate Dimension: 


Control Dimension: 


Police record system 


Interface Dimension: 


Future State Dimension: No police record in three years 
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nition Matrices, e.g., the input of a hospita! system is 
linked to the output of an emergency transport service. 

12) State dimension is a specification of anticipated 
changes and plans in specific time horizons for each of the 
four dimensions. For example, expanding the number of 
beds (physical catalyst) in two years or physicians (human 
agents) in three years ata hospital. 


REQUIRED INPUTS 

The primary input for specifying or developing a de- 
scriptive System Definition Matrix js to gain a familiarity 
with the existing system. For designing or planning a sys- 
tem, see IDEALS (IDL, page 231), 


TOOL OUTPUT 

The output is the System Definition Matrix with a par- 
tial or complete specification of elements and dimensions. 
The System Definition Matrix may then be used in other 
tools, such as Scnearios (SCN, page 164), Gaming (GAM, 
Page 124), Cost-Benefit Analysis (CBA, Page 212), and 
Computer Simulation Models (CSM, page 120). The 
IDEALS Strategy (IDL, page 231) uses the System Defini- 
tion Matrix asa format to specify results, 

An alternative breakdown of System elements which 
describes public service agencies may be used to avoid the 
input > sequence> Output terminology. The termin ology 
avoids the jargon used for the System Definition Matrix 
elements. The list and questions which may be associated 
with each element (and the corresponding matrix ele- 


ment) are: 


Purposes (function): Why? What is the mission? 

Background (information): What do] know? What are 
their previous states? 

Clients (inputs): Who? What are their Present states? 

Results (Outputs): What are the changed states of 
clients? 

Method (sequence): What ways? How to get results? 

Setting (environment): What is political or social 


atmosphere? 
People (human agents): Who are the doers? 


Facilities (physical catalysts): What is needed to do it? 
Dollars (inputs): What are the costs? 


IMPORTANT ASS UMPTIONS 


quite different functions. For example, hospital staff ars 
human azem<s in a patient treatment system and inpuss to 


the hospiza! management control system. 


METHOD OF USE 


GENERAL PROCEDURE 


The development of a System Definition Marix may 
be a creative as well as an analytical exercise, Consequent- 
ly, involving xnowledzeable staff is productive. Nominzal 
Group Techrigue (NGT, page 14) or brainstorming (BSG, 
page 3) may se used to discover entries: 

The procedure begins with function specification, bur 
May repeat ard backtrack as necessary, 


1. Specify che function. 
1.1 Discuss the system to determine its function fa 


function €xpansion, FEX, page 45, may be used). 

1.2 Proceed to the fundamental specification of other 
elements before specifying the other four dimen- 
sions of the system function. 


2. Identify inputs and other system elements, 

2.1 Try to complete all the entries for the funda- 
mental dimension column of the matrix, 

2.2 If a lise format is being used, skip dimensions of 
rate, congol, etc. and return to them after other 
elements have been specified. An alcohol work. 
shop identified the inputs for the treatment 
System as “clients with a drinking problem” 


(see fizure 2), 


3. Complete the dim ensions for each element. 


3.1 Complete the rate, control, and state dimensions 
for all elements except function. It may not be 
Possible to speci y all cells in the matrix, and they 
may be tem porarily left blank. 

3.2 If an element of the system does not include a 
Particular dimension, indicate “none required” or 
“not applicable, N.A.” in the matrix to show that 
the Possibility has not been overlooked, e.g., there 
may be no control dimension for system inputs, 
Figure 2 contains a description of a Partially spe- 
cified alcoholic treatment system, 


4. Complete system function dimension. 


4.1 Complez: the dimension specifications of system 
function if possible. 

4.2 In this ‘Ow, indicate foreseeable changes to the 
System function. 


r 


4.3 Note intecfaces with other systems, 


5. Complete interface dimensions. 
Where appropriate, complete the interface column of 
the System Definition Matrix for the eight elements. 
For example, the alcoholic treatment system inputs 
(clients) may interface with the output of public ser- 
vice agencies (e.g., the police). 


6. Check the matrix for completeness. 
Fill blank cells as additional information is gathered. 


7. Repeat process to desired level of detail. 
Pepeat the process for particular cells. For example, 
the control dimension of system output may suggest a 
subsystem whose function, inputs, outputs, etc. may 
be specified in a separate matrix. In this way, a very 
detailed morphological breakdown of a system and its 
subsystems may be modeled. 


EXAMPLE 


Figure 2 presents a partially specified System Defini- 
tion Matrix (in list format) for an alcoholic treatment 


system. 
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THEORY 


The theoretical basis for the System Definition Matrix 
is founded in the theory of systems. In defining what is 
meant by a system, different terminology and levels of 
detail may be used, but essentially a descriptive model is 
developed. 

The System Definition Matrix imposes a morphological 
structure on a conceptual model to produce a description 
of the system components. This may differ from similar 
systems descriptions in the explicit treatment of system 
functions and dimensions of rate and future state. Nadler 
(1970) is responsible for the System Definition Matrix 
format, particularly the emphasis on function and the ex- 
plicit treatment of catalysts. 
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Tree Diagrams 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


A tree diagram illustrates a set of complex relationships 
by fitting them into a hierarchy of related factors. 


USES 

Tree diagrams are used to: 

1) Describe the relationships among objectives of a 
project (see Objective Trees, OBT, page 49), 

2) Describe the relationships among alternatives, as in 
means-ends analysis or Decision Trees (DTR, page 141). 

3) Clarify sequences of relationships in Interaction 
Matrix Diagrams (IMD, page 92). 

4) Develop relationships among variables of a system 
as in influence trees which may then be redrawn as oval 
diagrams (OVD, page 81), 

5) Provide a measure of the degree of relatedness 
among different sets of factors, as in relevance trees, 


KEY DEFINITIONS 


1) A hierarchy is an ordered structure illustrating 
which factors are subordinate to others. 


2) Means-ends analysis is the identification of alterna- 
tive actions to achieve specified ends. 

3) An influence tree diagrams the variables which in- 
fluence other variables which are higher in the tree. 

4) A relevance tree diagrams the relationships among 
different sets of factors at each level of a hierarchy. 

5) A model is a representation or an imaginary entity 
that contains information ina certain predefined form and 
has specified rules for interpretation (Thesen, 1973). 

6) A tree graph is a set of linked elements where only 
one link exists between any two factors (see figure 1). 

7) A branching rule governs the construction of rela- 
tionships in a tree diagram (see figure 2), 


SHORT DESCRIPTION 

A tree diagram is a model which describes aset of rela- 
tionships by using a tree graph (see figure 1). The branch- 
ing points are factors related to each other according toa 
branching rule. The types of factors shown and the 
branching rule used are determined by the purpose of the 
diagram (see figure 2). For example, project objectives are 
modeled as objective trees (see OBT, page 49) to describe 
subordinate relationships. More information may be 
added to the diagram to facilitate analysis and to clarify 
relationships, €.g., to identify the levels of arelevance tree 


orto assign weights to alternative ou tcomes. 


_ =e 


FIGURE 1] 
Tree Graph Form 


aly Higher in Tree 


Level 2 


Level 3 


Level 4 


Lower in Tree 


BEY : 
O Factors (variables, objecuves, alternatives, etc.) 
‘= Relationships (causal, influence, subordinate, etc.) 


ADVANTAGES 

A tree diagram is constructed by doing a logical break- 
down of complex relationships. The branches of the dia- 
gram reduce asset of relationships to its essential compo- 


nents to expedite analysis. 


LIMITATIONS 
A tree diagram implies a level of determinacy which 


may be unwarranted. All elements of the diagram can sel- 
dom be determined in advance—a fact which must not be 


overlooked during subsequent analysis. 


REQUIRED RESOURCES 


SKILL LEVEL 


Tree dizgramming can be | 
her techniques may be required to make maxi- 


the skill level required de- 


earned rapidly with practice. 


Because ot 
mum use ot the tree diagram. 


pends on the purpose. 
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TIME REQUIRED 


Tree diagrams may be drawn rapidly as the develop- 
ment is usually quite logical. Some time is necessary for 
information-gathering and analysis. depending on the 


particular tvpe of tree diagram. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) A system is a collection of components which inter- 
act to achieve acommon function. 

2; A component of asystem is an entity which may be 
elemental or it may be a subsystem having distinct compo- 


nents. 
3) A stopping rule determines when any branch of the 


tree diagram should end. 

4) An influence relationship occurs when one van- 
able’s change in value influences change in another vari- 
able, e.g., the ACCEPTANCE OF INNOVATIONS is in- 
fluenced by the YIELD FROM CROPS. 

5) There is a producer-product relationship when one 
variable is a product of the other (e.g-, RANGE FEED isa 
product of AVAILABLE PASTURE). 


REQUIRED INPUTS 

The purpose of the tree diagram should be clearly es- 
tablished prior to its construction to determine the types 
of factors to be shown and the relationships to be de- 
scribed. Some familiarity with the problem context is 
necessary in order to be able to depict relationships and 


identify factors. 


TOOLOUTPUT 


Tree diagramming results in a description of a complex 
set of relationships. Simply developing the tree diagram 
may be sufficient for gaining an understanding into the 
structure of relationships and the span of relevance of van- 
ous factors. 

However, tree diagrams are usually the intermediate 
output of a more detailed analysis, e.g., influence dia- 
grams may be converted into oval diagrams (OVD, page 
81), and additional information can be gathered to com- 
plete a decision tree (DTR, page 141). 


IMPORTANT ASSUMPTIONS 


A hierarchical relationship is assumed to exist among 
the elements of a tree diagram. For example, if the set of 
complex relationships describes a system, then the tree 


diagram decomposes the system into components, each of 
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which may be further broken into components, etc. Or 
every system may be subdivided into subsystems, and con- 


sequently, every System is a component of some larger 


system : 


METHOD OF USE 


GENERAL PROCEDURE 

1. Determine the type of factors to be shown on the 
diagram. é 

2. Determine the appropriate branching rule. 

3. Determine the starting factor of the cree. 

4. Identify related factors using the branching rule 
and show them as branches stemming from the starting 
factor. 


5. Determine the appropriate stopping rule. 
6. Repeat step 4 for each newly identified factor 


unless the stopping rule applies. 


7. Review the tree for consistency of rule application. 


8. Add any information necessary for analysis. 


EXAMPLES 


Two examples will be used to illustrate the tree dia- 
gramming technique. Other applications are found in the 
Objective Trees (OBT, page 49), Decision Trees (DTR, 
page 141), and Interaction Matrix Diagrams (IMD, Page 


92). 


Relevance Tree Diagram 

A relevance tree can be used to describe the relation- 
ships of different elements in a family planning program 
(see figure 3). 

The starting variable is a simple identification of the 
mission of the program. The branching rule is in four 
parts: 

1) What are the goals which correspond to this mis- 
sion? 

2) What are the objectives which correspond to each 
goal? 

3) What are the targets for each objective? 

4) What are the instruments relevant to each target for 
accom plishing the objective? 

Identifying the instruments completes the tree and 
thus decomposes a complex program into its various 
elements. 


Influence Tree Diagram 
Much of the success of this technique depends on the 
art and expertise of the analyst. The example that follows 
¢xamines some of the relationships which describe the no- 
mad pastoralism eco-system, 


ee mys eee ee 
il ew ar rea ees mas --- 


The following excerpts from a description of an M.LT. 
study describe the factors affecting the conditions in the 


Sahel: 

In the Sahel live the nomads, who follow the rains to the north 
every year and recreat to the south in the dry season. Their num- 
bers have traditionally been limited partially by the number of 
cows and goats the land was able to support, and by the distance 
between water holes. Western agencies working in the area Curing 
the past decade made the obvious but ill-advised move of dizzirg 
wells throughout the grazing commons. The numbers of catzle, and 
people, grew Proportionately, using much of the grazing land for 


the greater part of the year instead of seasonally, allowing che land 
no time to recover. The herds moving southward during the dsy 


season have been forced to travel over land thar has already been 
Overgrazed and, finding water but no forage, have literally starred 


at the water holes. .. . 
It is this widespread overuse that is preventing the land from 


recovering even when rain does fall. Instead of being ab sorbed, the 
rain falling on the vegetation-stripped zround merely washes off 
the topsoil. The cycle—overgrazing, wind, rain—is Causing the de- 
sertification of much of the land.* 


The variables and relationships which describe the in- 
fluences on livestock population are shown in figure 4. 
The starting variable selected was HERD SIZE, an aggre- 
gated representation of all domesticated grazing animals in 
the Sahelian region. NOMAD POPULATION is an equally 
appropriate starting variable, but the tone of the excerpis 
Suggests that the relationships between animal Popula- 
tions and range conditions are central to describing the 
eco-system. 

The following branching rule was applied to each newly 
identified variable: 


Identify the variables which influence this variable. 


Other relationships can be diagrammed by inserting 
“produces” or “causes this variable to change” in the 
branching tule. The rule specifies the relationship, 
whether it is cause-effect, producer-product, or simply 
the influence of one variable on another. 

If the branching rule were ch anged to: 


Identify variables which are influenced by this variable, 


the direction of influence implied by the tree structure 
would be reversed. Generally, it is easier to Start with ob- 
served effects and attempt to identify causes, 

Two stopping rules were used to terminate the branch. 
ing process: 


1) Stop with any variable which is already shown on 
the diagram, or 


“aupe,, ‘Tragedy of the Commons’ in Africa," Technology Re. 
view (October-November, 1974), pp. 73-74. 
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2) Stop with any variable which is considered outside 
the purpose of the system, and which is not likely to be 
influenced by any other factor previously identified. 


Rule 2 applied for variables like SEASONAL RAIN- 
FALL and SOCIAL VALUE ON CONSUMPTION (see fig. 
+). Assuming that the eco-system functions to sustain life 
on the Sahel, these variables are considered outside the in- 
fluence of factors within the system. 

Rule 1 applied several times (e.g., HERD SIZE) and was 
employed to avoid redundant branching. When numerous 
branches terminate with the same variable, an oval dia- 
gram is a more economical form of representation for the 
complex relationships. This example is continued in the 
description of the oval diagramming technique (OVD, 


page 81). 


THEORY 


Tree diagrams are rooted in graph theory and the repre- 
sentation of hierarchical relationships (Warfield, 1973). 
The adoption of tree graphs for the tree diagramming tech- 
nique relates more closely to systems theory than to 
mathematical topology. 

Warfield (1974) has described the structural represen- 
tations of complexity which emphasize the correspon- 
dence between a matrix and a graph of relationships. A 
tree diagram may be used to trace the linkages in an inter- 
action matrix diagram (IMD, page 92) in order to clarify 
the interactions. 

The decomposition of a set of complex relationships by 
techniques, which Harrison (1972) has called a process of 
“‘repeated-subdivision,” assumes that the relationships 
form a hierarchy. The hierarchy may be a chain of cause- 
effect relationships, the nesting of one set of components 
within a larger component of a system, or the ordering of 
objectives from the specific to the general. 


Relevance trees have been discussed extensively in the 
technological forecasting literature (Alderson and Sproul, 
1972) as one of the more useful qualitative techniques. Ac- 
tempts to quantify the order and strength of the relaticn- 
ships in a relevance tree (Fischer, 1970) are beycend the 


scope of this presentation. 
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Oval Diagramming 


PREREQUISITE TOOLS 
Tree Diagrams (TRD, page 74). 


USAGE 
PURPOSE 


Oval diagramming describes a problem as a set of com- 
plex relationships among system variables and variables in 


the system enironment. 


USES 

An oval diagram provides an explicit statement of cause 
and effect relationships within a system and between the 
system and its environment. This diagram may be used to: 


1) Examine the internal consistency of the analyst's 
conception of the complex relationships. 

2) Communicate the analy st’s understanding of causal 
relationships to others and to provide a graphic definition 
of the system. 

3) Promote further study of hypothesized causes and 
observed effects, particularly when these represent prob- 


lematic behavior. 


4; Provide an input for techniques such as Computer 


Simulation Models (CSM, page 120) and Scenarios (SCN, 


pace 16+). 


KEY DEFINITIONS 

1) A variable is a factor used to describe a system 
which may change value as a function of time. 

2) The environment of a system is the set of all factors 
which are salient to the understanding of systems relation- 
ships, but which are outside the influence of the system 
variables. | 

3) Dynamic behavior is a consequence of delayed in- 
teractions among system variables. The dynamic state of a 
system depends on the prior values of state variables. 


SHORT DESCRIPTION 

An oval diagram is a model which identifies system vari- 
ables (in ovals) and the connecting arrows which link the 
variables together (see figure 1). The type of interaction is 
determined by considering the effect of a small change in 
one variable on the magnitude of another. 

An oval diagram is constructed by drawing on the ex- 
periences, observations, and intuition of the analyst(s) in 
order to translate mental models into an explicit state- 
ment. This statement forms the framework for testing 
hypotheses, gathering additional data, or analyzing the 


system's dynamic behavior. 


ADVANTAGES 


1) In oval diagramming, complex causes and effects 
are seen as expanding sequences starting from a key vari- 


able. 
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2) The thought that goes into oval diagramming often 
uncovers relationships that may be the key toa further un- 
derstanding of system behavior. 

3) Oval diagrams facilitate communication between 
analysts and decision makers by highlighting undesirable 
effects and relationships that require careful attention. 

4) By treating assumptions and hypotheses explicitly, 
oval diagrams may resolve discrepancies or deficiencies in 
the mental models used by decision makers. | 

5) The span of relevant factors is easily shown in the 
oval diagram so that changes in the problem scope can be 


accommodated by changing the diagram. 


LIMITATIONS 

1) Diagramming all conceivable interactions results in 
a complex and unwieldy diagram. On the other hand, high- 
ly aggregated models may lead to false inferences about 
system behavior (see DeNeufville and Stafford, 1969). 

2} The validity of the oval diagram can only be in- 
ferred by relation to experience. Any hypothesized rela- 
tionship may be proven false by a statistical analysis of 
data, but failure to do so does not validate the relation- 
ship. For example, it may be demonstrated that a relation- 
ship between NUMBER OF EXTENSION WORKERS and 
NUMBER “OF FARMERS ENTERING A PROGRAM 
does not exist; however, no test will assure one that there 
is a causal relationship. 

3: An oval diagram may be idiosyncratic because there 
is no unique representation of a complex set of relation- 
ships. 
4) The selection of salient variables and relationships 
reflects the biases of the analyst, even though the diagram- 
mer may attempt to incorporate shared values into the 
hy pothesized relationships. 

5) The oval diagram is a descriptive model only—the 
complex interaction of multiple variables and reJation- 
ships can only be inferred. Other techniques are required 
to fully understand the behavior of the entire system (see 


Com puter Simulation Models, CSM, page 120). 


REQUIRED RESOURCES 


LEVEL OF EFFORT 
The level of effort required depends on the planned use 


for the tool. 
1: If the oval diagram 1s a first step in complex model- 
ing and systems analysis, then the effort will match the in- 


gt recuirements of the tool used in the next step. 
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2) If the tool output is used for communication, dis- 
cussion, or training, then more effort may be spent on re- 
fining the final diagram. 

3) If the tool is designed to facilitate understanding as 
an aid to decision making, or for clarifying issues, then 
more attention must be given to the development process 
and explicit treatment of assumptions and hy potheses. 


SKILL LEVEL 

The analyst must be able to see the problem and envi- 
ronment as a system. A System Definition Matrix (SDM, 
page 67) may be useful here. 

When identifying variables, there is a ten dency to think 
only in terms of system components, €.g., organizational 
units. Thus skills used to identify system functions (Func- 
tion Expansion, FEX, page 45) and system performance 
measures (Logical Framework, LGF, page 260) can be use- 
ful. Oval diagramming must be learned by repeated at- 
tempts at describing complex relationships. 


TIME REQUIRED 

Oval diagrams may be constructed either in a short time 
(less than an hour) or over a longer time (e.g., the life of a 
project), depending on the level of detail and internal con- 


sistency desired. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 

1) A causal chain is a sequence of cause and effect re- 
lationships between variables (see figure 2). 

2) A causal loop is a causal chain which is connected so 
that a change in any variable eventually feeds back 
through the chain to affect this variable. A causal loop has 
a feedback effect (see figure 2). 

3) Mutually-causal variables occur when a change in 
one variable causes a change in another which is fed back 
to affect the first, e.g., a causal loop involving only two 
variables (see figure 2). 

4) Feedback structure is the set of relationships de- 
scribing a system that involves one or more interlocking 
causal loops (see figure 1). 

5) Correlation is an observed relationship between two 
or more variables in which the changes in one variable may 
be associated with predictable changes in another; the re- 
lationship, however, is not necessarily cause-effect. 

6) Logical inconsistencies occur when hypothesized 
relationships among variables are inconsistent. This may 
result from an imprecise variable definition, faulty logic, 
or a confusion of correlative behavior with cause-effect re- 


Jationships. 
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Kinds of interactions: 


1) A direct eftecr is an interaction between two vari- 
ables so that a change in one results in a similar change in 
the other, i.e.. either both increase or both decrease (see 


figure 3). 


2) An inverted effect is an interaction between two 
variables so that a change in one results in an opposite 
change in the other. i.e.. if one increases the other de- 
creases. it one decreases the other increases (see figure 3). 

3} A threshold effect occurs when one variable does 
not change until the other variable changes significantly 


(see figure 4. 


4+) A vanable interaction is irreversible if the variable 


only increases or only decreases (see figure 5). 
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FIGURE 3 
Types of Interaction Between 


Two Variables. Aand B 


Direct 
Effect 


EXAMPLES: 

HYBRID SEED YIELDS (Variable A) influence NUM 
BER OF NEW ADOPTERS (Variable B) 

POPULATION OF FERTILE FEMALES (Variable Aj 
produces NUMBER OF BIRTHS (Variable B) 
FERTILIZER APPLIED (Vanable A) causes CROP 
YIELD (Variable B) 


Inverted 


Effect 


Increases 


EXAMPLES: 
ANTI-SMOKING ADVERTISING (Variable A) influences 
CIGARETTE CONSUMPTION (Variable B) 

EXTENT OF FLOODING (Variable A) produces CROP 
YIELDS (Variable B) 

CONTRACEPTIVES AVAILABLE (Variable A) causes 
NUMBER OF BIRTHS (Variable B) 


FIGURE 4 
IWusoanon of Threshold Relationships 
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Effect A must decrease 
significantly before 
B increases 


EXAMPLE: 


When COOPERATIVE MEMBERSHIP (A) exceeds a 
threshold number, FARMGATE PRICES (B) may he 
affected 


EXAMPLE: 


When POLITICAL AGITATION (A) exceeds a level of 
tolerance, the LEVEL OF CIVIL LIBERTIES (B) is 


affected 


FIGURE 5 
lWustration of Irreversible Effects 
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EXAMPLES: EXAMPLES: 

Increasing PRICES (A) cause increasing WAGE DE- Increasing OIL CONSUMPTION (A) decreases (depletes) 

MANDS (C) the OIL RESERVES (C) 

Decreasing PASTURE RECOVERY RATE (B) causes Decreasing PRODUCT QUALITY (B) decreases (destroys) 
COMPANY REPUTATION (C) 


increasing DESERTIFICATION (C) 
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REQUIRED INPUTS 

Oval diagramming is most effective when the purpose is 
to increase understanding of a complex problem. Familiar- 
ity with the problem situation is therefore desirable, 
though much of the input will come from a basic under- 
standing of relationships, e.g., the mental models that are 
tormed from experience and observation. 

When oval diagrams are constructed by a team, the 
members should broadly represent those concerned with 
the problem. More than five people working on one dia- 
gram limits effectiveness. | 

Tree diagrams (TRD, page 74) may be used to help 
identify variables. An interaction matrix diagram (IMD, 
page 92) is also useful for identifying the significant inter- 


actions. 


TOOL OUTPUT 

The output is an oval diagram which provides a graphic 
statement of the variables and relationships necessary to 
describe the system. The boundary of the system and the 
scope of possible interventions are defined. 

The oval diagram focuses attention on the need for 
further information-gathering and testing of hy pothesized 
relationships. The oval diagram provides the basic input to 
other techniques such as Scenarios (SCN, page 164) to 
gain greater understanding of system dynamic behavior. 


IMPORTANT ASSUMPTIONS 


Decision makers use mental models as well as more 
formal models to understand behavior and select choices 
of action. Mental models may be very complex, yet they 
are seldom made explicit except by inference from the ac- 
tions of the decision makers. Oval diagramming depends 
on the ability of analysts (and decision makers) to picture 
the hypothesized relationships and the assumed causes 
and effects. 

The assumed interactions between variables is identi- 
fied by considering small changes in the causal variable. 
Relationships often change character when large magni- 
tude variations occur, but an examination of this behavior 
is outside the province of this technique. 

The oval diagram represents a definition of the system 
that is distinct from the environment. Setting a boundary 
between the system and its environment assumes a hier- 
archical relationship between systems and the larger 
systems which contain them. Hence, any environmental 
variable is part of an expanding systems hierarchy (see 
Tree Diagrams, TRD, page 7+). 


METHOD OF USE 
GENERAL PROCEDURE 


Oval diagramming is essentially a trial and error pro- 
cess. Therefore it is important to start diagramming im- 
mediately. The recommended procedure is to start” with a 
simple tree diagram (TRD, page 74) and when many 
factors keep reoccurring in difterent branches of the zee, 


to switch to an oval diagram. 


1. Construct a tree diagram of the system. 
1.1 Identify variables for an influence tree. 
1.2 Select a starting variable which describes the con- 
‘dition or symptom of the problem in neurral 
terms. 
1.3 Construct the tree branches after each variable by 
identifying the variables which influence (or pro- 
duce or cause) this variable to change value. 


- Convert the influence tree to oval diagram form. 

2.1 Locate the starting variable in the center. 

2.2 Cluster the in flueacing variables around ir. 

2.3 Indicate the branching relationships as arrows be- 
tween ovals. 

2.4 Form causal chains of variables. 

2.5 Do not repeat variables on the diagram. Form 
causal loops back to previously shown variables. 


i) 


3. Identify the types of interactions between variables. 

3.1 Isolate two variables and imagine the effect thata 
small increase in the causal variable will have on 
the affected variable, assuming that all other 
factors do not change. 

3.2 Indicate whether the relationship is a direct or in- 
verted effect (see figure 3). 

3.3 Indicate if a threshold effect is hypothesized (see 
figure 4). 

3.4 Indicate if the variable interaction is irreversible 


(see figure 5). 


4+. Identify variables outside the system, 

4.1 Apply the influence tree stopping rule (TRD, page 
74) to identify any factor which is outside the 
influence of other variables within the system. 

4.2 Enclose these variables in a box to distinguish 
them from system variables (Optional). 


5. Review the diagram for consistency. 
5.1 See if the variables reflect a similar level of detail/ 


aggregation. 


—_—_— 


“Oval diagrams may be constructed from Interaction Matrices but 
this emphasizes identifying all variables first, then determining the 


relationshias. 


FIGURE 6 
Summary of Symbols and Notation for Oval Diagramming 


MEANING 


VARIABLE 


EXOGENOUS VARIABLE 


VARIABLE WHICH ONLY INCREASES 


VARIABLE WHICH ONLY DECREASES 


DIRECTION OF CAUSALITY 


DIRECT EFFECT. 


INVERTED EFFECT 


NATURE OF INTERACTION CHANGES 


NATURE OF INTERACTION UNCERTAIN 


THRESHOLD EFFECT 


BREAK IN ARROW (FOR DIAGRAM CLARITY) 
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5.2 Eliminate any redundant relationships. 

5.3 Look for spunous correlations, e.g.. two variables 
which are snown as causally related when tne up- 
parent cause and effect interaction is actually the 
eftect ota third variable. The classic example is the 
correlation berween FIRE TRUCKS and FIRE 
DAMAGE. The number of fire trucks responding 
to a tire does not cause the amount of damage: the 
size of the nre afteces both variables (DeNeutville. 
1969. 

Test the causal chains of hypotheses by consider- 
ing the radiating effect of a small change in a vari- 
able in che chain. Are the sequences ot interactions 
consistent with the observed behavior in the 


5.4 


svstem? 


6. Complete the diagram for display or analysis. 
6.1 If necessary, redraw the diagram to clarify rela- 
tionships (see figure 6). 
6.2 Isolate causal loops and key variables by highligh t- 
ing or diagramming them separately. 


EXAMPLE 
The eco-system problem which was diagrammed as an 
influence tree (see Tree Diagrams, TRD, page 7+) will be 


continued. 


Construct a Tree Diagram of the System 

The tree diagram represents factors which interact to 
cause the nomad population’s problems in the drought- 
stricken Sahel. A starting variable for the diagram was 
selected by first stating the known condition or symptom 
which describes the problem: the region is overpopu- 
lated with borh people and animals. The tree diagram 
could have been started with OVERPOPULATION OF 
NOMADS or OVERSIZED HERDS. However these vari- 
ables are nor neutral, e.g., Overpopulation is only relative 
to available resources. Consequently, HERD SIZE was 
selected* because it may either increase or decrease in rela- 
tion to other variables. This permits the problem to be re- 
presented as the interaction am ong system variables. 

Repeated application of the branching rule, “Identify 
the variables which influence this variable,” for each new- 
ly identified variable resulted in the completed diagram 
shown in figure 7 (see Tree Diagrams, TRD, page 74). In 
Practice, only a partial tree is needed to start the oval dia- 


gram. 


"NOMAD POPULATION would have been an equally acceptable 
Staring variable for the tree diagram. 


—————— i cc Se ee 


Convert the Influence Tree to an Oval Diagram 

The starting variable was drawn in the center with the 
variables which influence ir clustered around (sec figure 
8;. The branches of the tree diagram became arrows be. 
tween the variables which became ovals. Each branch be- 
came a causal chain, and when a variable was repeated in 
the tree diagram (e.g., HERD SIZE) a causal loop was 
formed (see figure 9, the mutually causal-relatienship be- 


tween HERD SIZE and WATER A VAILABLE.. 


FIGURE 7 
Influence Tree Diagram Prepared to 
Start Oval Diagram of 
Nomad Pastoralism Eco-System 


SEASONAL 


RAINFALL 
WATER HERD 
AVAILABLE SIZE 

DEEP 


WELLS 


AVAILABLE 
PASTURE 


RANGE 


GRAZING 
PRESSURE 
HERD 


SIZE 
YIELD 


OF HERD 


INCOME 


SOCIAL 
VALUES: 
CONSUMPTION 


DEMAND 
FOR FOOD 


DESIRED 
HERD 
SIZE 


CULTURAL 
NORMS 


FIGURE 8 
The Initial Steps in Constructing an 
Oval Diagram froma Tree Diagram 


Idenrify the Types of 
Interactions Between Variables 

If HERD SIZE were to increase by some small amount, 
the WATER AVAILABLE would decrease if all other 
factors were held constant. The — sign by the arrowhead 
on the relationship shown in figure 9 indicated this in- 
verted relationship. By posing similar changes between 
each pair of related variables (considering only one rela- 
tionship at < time), the analyst indicated on the diagram 
the hypothesized interaction between the variables. 

One such hypothesis concerned the relationship be- 
tween the RATE OF PASTURE RECOVERY and the 
AVAILABLE PASTURE. If the RATE increased slightly, 
the AVAILABLE PASTURE was directly affected. If the 
rate decreased below some threshold value, the relation- 
ship became distorted (DESERTIFICATION increased 
irreversibly, which decreased the AVAILABLE PAS- 
TURE). These hypotheses were noted on the oval 
dizgzam using the symbols shown in figure 9. 


Identify Variables Outside the System 
Tne SEASONAL RAINFALL was shown as a variable” 
which was outside the system. Although this variable pro- 
Cuced the WATER AVAILABLE and influenced the 
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RATE OF PASTURE RECOVERY. nothing within the 
system diagram was hypothesized to influence the SEA. 
SONAL RAINFALL. 

Other factors were added to the oval diagram (see 
figure 1) to show the effects of external in terventions on 
the system, e.g., digging DEEP WELLS or un posing 
RANGE LIMITATIONS and HERD CONTROL on the 
nomads by government interference. Each of these actions 
were determined by levels of variables within the System 
and could also be shown on the diagram ™* (e.g., the rela- 
tionship between GRAZING PRESSURE and HERD 


SIZE CONTROL). 


Review the Diagram for Consistency 

One of the biggest problems in oval diagramming is to 
show widely varying levels of detail (disageregated vari- 
ables). In this example, all nomads and all livestock were 
aggregated into just two variables: POPULATION and 
HERD SIZE. The oval diagram could be restructured to 
show regional variables or tribal groups. but this detailing 
should follow a first attem pt at a more general model. 

A redundant relationship was shown initially in the 
oval diagram between HERD SIZE and RANGE FEED 
(compare figure 9 with figure 1). GRAZING PRESSURE 
was defined to link HERD SIZE with RATE OF 
PASTURE RECOVERY. When reviewing the diagram, it 
was observed that the effect of HERD SIZE on RANGE 
FEED was accounted for by the linkage through 
GRAZING PRESSURE. 

Social value relationships were shown rather ambigu- 
ously on the diagram. A relationship between DESIRED 
HERD SIZE and NOMAD POPULATION was hypoth- 
esized to include not only the DEMAND FOR FOOD but 
a set of CULTURAL NORMS. The norm may be a tradi- 
tion that X cattle are desired for Y family members. Such a 
hy pothesis requires that information be gathered for 
further study. 

SOCIAL VALUES : CONSUMPTION influence how 
the YIELD from the HERD was to be taken—either to ef- 
fect FOOD SUPPLY orto produce INCOME from milk or 
beef sales. The INCOME may be applied to further build 
up the HERD SIZE. By constructing these narratives, the 
hypothesized relationships represented in the oval dia- 
gram were systematically examined. It is important, how- 
ever, to consider both increases and decreases in key vari- 


ables. 


“It would have been an error to depict DROUGHT as a variable 
since this is just a very low level of the neutral variable, SEA- 


SONAL RAINFALL. 
“*The relationships hetween outside interventions and system 
variables are described further in the continuation of this example 


in Interaction Matrix Diagrams. 
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Complete the Diagram for Display or Analysis 

There were a number of interacting causal loops which 
led to the problems of the nomads. Each of these loops 
could be isolated for further analysis and perhaps pro- 
grammed on a computer simulation model (CSM, page 
120) (Picardi, 1974). For purposes of presentation to deci- 
sion makers, it is desirable to isolate these major effects by 
redrawing the diagram or highlighting the relationships 
involved. Transparent overlays are effective in construct- 
ing the model before an audience. Color-coding and geo- 
metric shapes (other than ovals) are also effective in clari- 
fying the complex causal hypotheses. 

At the very least, this example illustrates the kinds of 
interactions which help to orient efficient information- 


gathering for detailed analysis and design. 


THEORY 


Oval diagramming, or causal modeling, draws from 
many disciplines including economics, sociology, busi- 
ness, and engineering. DeNeufville and Stafford (1969) 
describe the use of “arrow diagrams” to model the causal 
relationships between variables. The field of Systems 
Dynamics (Forrester, 1968) stems from efforts to model 
the complex relationships which lead to problematic be- 
havior in industrial organizations. The MIT group sub 
sequently attempted to model cities (Forrester, 1969) 
and the world (Meadows, 1972). 

While these efforts were mainly concerned with de- 
veloping a computer simulation model to test hypotheses 
and demonstrate the probable consequences of different 
policies, each must start with a causal model or oval dia- 
gtam of the relationships to be tested. 

The work of Harrison (1972) and Abraham (1975) is 
particularly noteworthy in their attempts to translate 
complex techniques into straightforward models of 
problematic system behavior. 

A second approach concentrates on identifying the 
structure of interactions (see Interaction Matrix Diagrams, 
IMD, page 92). Interpretive Scructural Modeling (War- 
field April, September, 1973; 1974) relies on com- 
puter assistance to manipulate the matrices of relation- 
ships into a mode]. An interaction matrix has a direct cor- 
respondence to an oval diagram and provides a powerful 
technique for automatically analyzing large numbers of 
complex interactions. Gerardin (1973) describes an appli- 
cation of the technique to planning, and at a recent con- 
ference (IEEE Conference, 1976) several authors applied 


the rechnigue to deve!opment problems. 
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Interaction Matrix 
Dj agramming 


PREREQUISITE TOOLS 


Tree Diagrams (TRD, Page 74) and Oval Diagramming 
(OVD, page 81). 


USAGE 
PURPOSE 


Interaction matrix diagrams describe complex relation- 
ships by identifying self-interactions within members of a 
set and cross-interactions between members of different 


sets of elements. 


USES 


Interaction matrices may be used singly or in combina- 
tion to: 

1) Identify the elements (e.g., objectives, constraints, 
Or systern variables relevant to the description of a prob- 
lem, project, or system), 

2) Systematically explore the possible interactions 
within a set of elemen ts, using a self-interaction matrix. 

3) Indicate the existence, strength, importance, or dij- 
rection of an interaction between any two elements, 

4) Identify the interactions between two different sets 
of factors, e.g., between project objectives and activities. 

5) Provide a matrix checklist forrecord keeping, com- 


Munication, and planning. 


KEY DEFINITIONS 

1) A matrix is a mathematical and graphical represen- 
tation in two dimensions. 

2) A self-interaction matrix represents relationships 
within a single set of variables. 

3) A cross-interaction matrix represents relationships 
between dissimilar sets of variables. 

4) A reduced matrix is formed by omitting one or 
more rows or columns from the Original matrix. 

5) A set isa collection of elements having some com- 
mon property. 

6) A matrix entry is the symbol used to indicate the 
existence or absence ofa relationship between the element 
in the row and the element in the column (which together 
define the entry). 


SHORT DESCRIPTION 


Interaction matrices provide a technique for first iden- 
tifying the members of a set of elements, e.g., the objec- 
tives for a project, and then systematically examining all 
the possible interactions among members of the set. If the 
factors can be categorized, the cross-interactions between 
members of different categories can be determined (see 
figure 1). A matrix entry may show a range of informa- 
tion, including whether the relationship between the two 
elements has been hypothetically or empirically deter- 
mined, or whether the relationship is or would be desirable 
if it were established. The matrix entry may also show the 


eS See ae esses eS aia Su 


relative strength or importance of the interaction. 
Interaction matrices correspond directly to tree diagrams 


(TRD, page 74) and oval diagrams (OVD, page 81). 


ADVANTAGES 


1) All factors relevant to the description of a problem 
or system are identified in a separate exercise prior to spe- 
cifying interactions. 

2) All possible’ interactions between elements are 
examined in a systematic procedure which minimizes 
omissions and tests for inconsistencies. 

3) The existence of a relationship is determined with- 
out having to further specify the type or degree of inter- 
action. 

4) A large number of variables may be analyzed with- 
out significantly affecting the clarity or utility. 

5) The matrix provides a convenient means of record- 
ing information and tasks for further study. 
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6) The procedure lends itself to a multi-disciplinary 
approach. 


LIMITATIONS 


1) Separating the tasks of generating elements and 
identifying relationships may run counter to thought pro- 
cesses, e.g., tracing cause-effect chains or the order of pref- 
erence among descriptive elements. In these processes, 
new elements often emerge as relationships are examined 
(see Tree Diagrams, TRD, page 74). 

2) The number of relationships to be examined in- 
creases as the square of the number of matrix elements, 
e.g., there are nine possible interaction pairs among three 
elements. Fortunately, not all interactions need to be 
examined, but the process can be time-consuming. 


*This assumes that the interaction of an element with itself must 


be examined. 


FIGURE 1 
Interaction Matrix Diagram Derived from Oval Diagram of Nomad Pastoralism Relationships 
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3) Tracing cyclical relationships and other linkages 
through the matrix structure can be confusing. An oval or 
tree diagram provides greater clarity than the matrix 


format. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

Construction of interaction matrix diagrams requires 
two distinct tasks: identifying relevant elements, and an- 
alyzing interactions among them. The first task may ex- 
ploit the collective judgment of a large group using brain- 
storming (BSG, page 3) or the Nominal Group Technique 
(NGT, page 14). Secondary information sources may also 
be used to develop the list. 

The task of identifying relationships requires consider- 
able effort and expertise. This may bea team task if care is 
taken to explain the elements and the relationship which is 


to be examined. 


SKILL LEVEL 
Some skill is required to diagram the interaction 
matrices in order to preserve clarity, and to interpret the 


linkages between elements. 


TIME REQUIRED 

The construction of an interaction matrix for a rela- 
tively small number of factors may take hours, depending 
on-one’s ability to assess the matrix entries and the 
amount of information included. 


SPECIAL REQUIREMENTS 


Interaction matrix diagrams may be constructed using 
special computer programs. This greatly facilitates the 
systematic analysis of many elements and permits quick 
and accurate performance of matrix operations (Warfield, 
1974), 


DESCRIPTION OF TOOL 
SUPPLEMENTAL DEFINITIONS 


1) A transitive relationship requires that a directed re- 
lationship among three or more elements be consistent, 
e.g., if Ais preferred to B, and if B is preferredtoC, thenA 
must be preferred toC (see figure 2), 

2) A directed relationship specifies that the existence 
of the relationship is dependent on the order in which the 


two elements are considered, e.g., “is influenced by,” “‘is 
preferred to,” and “is subordinate to.”” 


NOTE: “1” means that row element i is 
element j. ‘0’ means that relationshin R does noe 


SYMBOL DEFINITIONS: 


MATRIX RELATIONSHIP PROPERTIES 


FIGURE 2 
Properties of Relationships 


Self-Interaction Sasrix of Relationship R 


related to columa 
apply bervern 


the elements. 


Oval Diagram of Matrix Assuming 
a Directed, Incransitive, Asymmecical 
and Irreflexive Relationship R 


a, b,c, d, and e are elements of a set, 
i,j are any two elements. 

R denotes a relationship between any two elements, 
aR b signifies that element a is related to element b by 


the relationship R, 


Reflexivity, A relationship is reflexive ifa R a,bRb, 
-++1R i, If noe, the relationship is irreflexive because 
all the diagonal elements ae UU.” 

Symmetry, A relationship between two elements is 
symmetrical if when i R j, then j R i For example, 
Group A ‘communicates with (R)” Group B. In this 
case, the two halves of the matrix are symmetrical 
about the diagonal. If not, then the relationship is 
assyme trical 

Transitivity, A relationship is transitive if when aRb 
and b R d then aR d. For example, project A “is 
preferred to (R)” Project B which is preferred to 
Project D, therefore Project A must be preferred to 
Project D. If not, the relationship is intransitive. The 
entries at column a of rows b and e are dirferens, 
indicating an intransitive relationship (or an inconsist- 
ent matrix entry). 


3) A reflexive relationship occurs when the variable in- 
teracts with itself (see figure 2). 

4) A symmetrical relationship means that the relation- 
ship between two elements is non-directed, ie., the 
elements interact independent of the order in which they 
are considered (see figure 2). 


5) Linearly linked matrices have a common set of rows 


or columns. 

6) Orthogonally linked matrices have the same set of 
elements in the rows of one matrix and the columns of the 
other matrix. 


REQUIRED INPUTS 


If the interaction matrix diagram is to bea group effort, 
team members should be familiar with the problem or 
project. They should have diverse backgrounds in order 
to provide a broad perspective on relevant elements and 


possible relationships. 


TOOL OUTPUT 

The interaction matrix diagram provides a useful 
medel, but may also be an intermediate product which is 
used to guide further information-gathering and study. 


IMPORTANT ASSUMPTIONS 


The diagramming process represents a mapping of an 
internal mental model to an explicit format (matrices). 
The technique systematizes the mapping process by ex- 
amining only one pair of elements at a time. This may re- 
sult ina relationship between two elements which is incon- 
sistent with the interaction of each element to other 
elements (e.g., a transitive relationship among elements is 
violated). In this case, it must be assumed that the mental 
model is incorrect, though a cognitively complex view of 
the relationship may be the source of the discrepancy. 


METHOD OF USE 


GENERAL PROCEDURE 

Throughout the following procedure, remember that 
interaction matrices are constructed by simply making an 
er.try at the intersection of a row and column which indi- 
cates whether there is a specified relationship between the 


corresponding elements. 


1. Specify the type of elements and the relationship. 
1.1 Specify if the element set is objectives, con- 
straints, agencies, needs, variables, interven- 


tions, etc. 
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1.2 


13 


1.4 


Specify if the relationship is directed or non- 
directed, e.g., non-directed relationships in- 
clude “is associated with,” “communicates 
with,” and “interacts with.” 

If the relationship is directed, i.e., from one 
element to the other, then specify if the rela- 
tionship is transitive or intransitive (see defini- 
tions in figure 2). 

Specify if the relationship is reflexive or not 


(see figure 2). 


2. Generate alist of elements for each set. 


2.1 


Ask the question: What elements are necessary 
to describe the (type of element) for the (con- 
text)? For example, “What elements are neces- 
sary to describe the objectives of an integrated 
rural development project?” 


2.2. Combine individual answers to this question if 


a group process is used, e.g., brainstorming 
(BSG, page 3), Nominal Group Technique 
(NGT, page 14), or Delphi (DLP, page 168). 


3. Construct the interaction matrices. 


i | 


List all the elements of one type in the rows of 


a matrix. 


3.2 Prepare a self-interaction matrix by repeating 


this list of elements as the columns of the 
matrix to form a square (see figure 1). 


3.3 Prepare a cross-interaction matrix by listing 


elements from a different set in the columns of 
the matrix to form a rectangular matrix (see 


figure 1). 


4. Determine matnx entries. 


4.1 


4.2 


4.3 


4.4 


4.5 


Specify the symbol for a positive entry to indi- 
cate the existence of a relationship, e.g., ‘/,” 
‘*X,” or “1” (see also figure 1). 

Specify the symbol which indicates that there 
is no interaction between two variables (e.g., 
“0” or blank). 

Beginning with the first row of the matrix, 
apply the relationship test to the rowelement 
and each column element. Test by asking: Is 
(element i) (relationship) (element j)? For ex- 
ample, ‘Is Project A preferred to Project B?” 
or “Is variable X influenced by variable Y?” 

If the answer to the relationship test is posi- 
tive, then the corresponding matrix entry is 
the positive symbol specified in step 4.1, If 
not, either enter “0” or make no entry. 

If a group process is used to examine each rela- 
tionship, use a majority vote or group con- 
sensus to answer the relationship test. 
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4.6 


Repeat this test for the entries in the re- 
maining matrix rows until all possible matrix 


entries have been determined. 


5. Examine the matrix for consistency. 


5.1 


5.4 


If the relationship is reflexive, confirm that 
the diagonal entries are positive (see example, 
figure 2). 

If the relationship is irreflexive, the diagonal 
entries should be zero. 

If the relationship is symmetrical (e.g., a non- 
directed relationship such as ‘“‘is associated 
with”), then confirm that each positive row i- 
column j entry in a self-interaction matrix has 
a corresponding row j-column i entry which is 
positive. Otherwise, the matrix entry is incon- 
sistent (see example, figure 2). 

If the relationship is directed and transitive, 
follow the iterative procedure shown in figure 
3 to test whether an intransitive relationship 
has been erroneously entered in the matrix. 
For example, assume that the matrix in figure 
2 describes a relationship between elements 
which is transitive, e.g., element i is subordi- 
nate to element j. Comparing the positive 
entries in the bottom row (e) with the positive 
entries in row 6 (step 7 in the test sequence) 
indicates that the column a entries are incon- 
sistent. If e is subordinate to b, and if b is sub- 
ordinate toa, then e must be subordinate toa 
or the relationships would be intransitive. 


6. Specify the relative degree that the relationship ap- 
plies (optional). 


6.1 


6.2 


Determine a scale to indicate the degree of in- 
teraction (e.g., 0 to 10, or 0 to 3) (see Rating 
Scales, RTS, page 29). 

For each row, assign a scale value to the entries 
which indicates a relationship. The value 
determined should reflect the relative degree 
to which the relationship applies compared to 
the other relationships in that row, e.g., the 
strength of interaction between the two vari- 
able elements (see example on page 99}. 


7. Construct a reduced matrix (optional), 


7.1 


Fuk 


Eliminate any elements from a cross-inter- 
action matrix which have no positive relation- 
ships with elements in the other set by striking 
the row or column from the matrix. 

Eliminate any element in a self-interaction 
matrix only if it has no positive row und 
column entries, e.g., it does notinteract with 
any other element within the set. 


Vea 


Eliminate any element where the degree of re- 

lationship is shown as an entry if none of the 
. reer 

entries for that element are above a szecified 


scale value (see example on page 99). 


2 : kh ; ; 
8. Construct an interaction matrix diagram (optional). 


8.1 


8.2 


Two interaction matrices may te linked to 
gether by repeating one or more elements of 
one set in both matrices ‘see HERD SIZE in 
matrices A and C in figure 1). 

Matrices may be linked together by alrernatinz 
cross- and self-interaction matrices (see figure 
1) to form linearly linked matrices oz orthc- 
gonally linked matrices. For the latter, the 
self-interaction matrix becomes a pivot point 
between two cross-interaction matrices. 


9. Clarify the interaction matrix by constructing a tree 
diagram (optional). 


4 


9.2 


a3 


9.4 


Select a row of the marrix as the starting ele- 
ment of the tree (see Tree Diagrams, TRD, 
page 74). 

Branch the tree at each positive column entry. 
The element on the branch corresponds to the 
column element. : 

For each of these elements the process may be 
repeated by branching at the positive entries 
on their respective rows. For the matrix in 
figure 2, a tree started with the element e 
would first branch to elements b andc, each of 
which would branch to element a. The branch- 
ing rule in this procedure is simply the inter- 
action matrix relationship, e.g., identify all the 
elements to which this element is subordinate. 
To tree diagram the converse of the relation- 
ship, repeat the above procedure, but branch 
in each case at the positive entries in the 
column of the element. The branching rule 
then becomes in effect flipped around, €.2., 
identify all the elements which are subordi- 
nate to this element. The oval diagram in 
figure 2resembles sucha tree structure, except 
that element eis not shown twice. 


10. Clarify the interaction matrix by constructing an oval 
diagram (optional). 


10.1 


10.2 


10.3 


2 eee eee 


Select the row element with the most positive 
entries as the starting element. 

Cluster all the elements which have positive 
column entries about the starting element. 
Draw lines which correspond to the relation- 
ship between each of the elements of a POsitive 
matrix entry. 


SO ert ee eaten 6 os as stots 
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FIGURE 3 
Examining an Interaction Matrix for Intransitive Relationships 


Step 1 Start with Bottom Row 
Does 
Step 2 This Row Have Go to the 
Any Positive Next Higher Row 
Entrics‘ in the Matrix 
Step 3 Go to First Column (Working up the Matrix) 
Goto the Next 
Column to the Right 
(Working Across the Row) 
Are 
Step 4 There More 
Columns in the 
Row? 
Go to the Row 
Step 5 Which Corresponds 
to This Coitumn 
Element 
(Checking for Transitive Relationships) 
(Flowcharting, FLW, page 107) 
: Retum 
Step 6 There any Positive kobeion 
Enmes ix. This Original Row 
(Comparing Column Entries for Two Different Rows) 
REY: 
Elements wich Mack 
Positwe Enciss wa erg Action 
Step 7 Also Marked with rat Orga 
vive ow Entry as 
Positive Enmmss ie ea esine 


in the 


. isc! 


Rew? 


<> Decision 


Sequential 
Order 


a 5 -eceindeamanier. aleinigey tpt ol. ee ee EEE | cm penenepneey =: 


FIGURE 4 
Reduced Cross-Interaction Matrix for Environmental Assessment 
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10.4 If the relationship is directed, e.g., “a is pre- 
ferred to b,” locate the arrowhead at the end 
of the linkage in a way consistent with the 
meaning of the relationship. For example, the 
oval diagram for the matrix in figure 2 places 
the arrowhead at the oval surrounding the ele- 
ment which is second in the relationship “‘b is 
subordinate toa.” 

Add remaining elements and links to the dia- 
gram where each link corresponds toa positive 
entry on the matrix. 

If the relationship is symmetrical, only the 
positive entries on one side of the matrix 
diagonal need to be diagrammed. 

If the relationship is reflexive, an arrow may 
be shown emitting from the oval and looping 
back to it, though such links are often 
omitted. 

If the relationship is transitive, the matrix will 
contain a number of entries which represent 
redundant links on an oval diagram. These 
may be omitted as shown in the link arrows 
from eto aanddtoain figure 2. 

An intransitive relationship may be oval dia- 
grammed as a feedback loop, e.g., the rela- 
tionship “‘is affected by.” 

10.10 Confirm that the diagram is complete by 
‘ counting the number of connecting arrows, 
any omitted reflexive loops, and any omitted 
redundant intransitive links. The total should 
equal the number of positive matrix entries. 
The information on degree of relationship 
may be transferred to the oval diagram by as- 
sociating the scale number with the connect- 
ing arrow (e.g., either adjacent to the arrow- 


head or ona box on thearrow). 


10.5 


10.6 


10.7 


10.8 


10.9 


10.11 


EXAMPLES 


-«£ 


Constructing a Reduced Cross-Interaction Matrix 
A set of existing environmental characteristics or con- 


ditions, such as water quality and erosion, were identified 
and listed by various categories to reflect the environ- 
mental concerns of donor-funded development projects 
‘Environmental Assessment Guidelines Manual, 1974). A 
second set of actions which cen influence the environment 
were also identified by using several categories of actions. 
These included “alteration of ground cover,” energy 
generation,’ etc. 

A sample environmental assessment was then con- 
ducted by constructing a cross-interaction matrix which 
listed the environmental characteristics as rows and the ac- 
tions as columns (see figure +). Matrix entries were scaled 
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from 1 to 10 (see Rating Scales, RTS, page 29). The first 


entry for each combination of condition was determined 
by an assessment of the relative strength of the inter- 
action. This was done for every probable combination. A 
second entry assessed the relative significance of the inter- 
action. Finally, a reduced cross-interaction matrix was 
formed by eliminating the rows and columns. The reduced 
matrix contained only those elements whose interaction 
had a strength or significance greater than 2 on the relative 


scale. 
This matrix pinpointed the probable areas where 


project actions may have either a strong or significant 


environmental impact. 


An Interaction Matrix Diagram 
of the Nomad Pastoralism Eco-System 

The problems of the nomads in the drought-stricken 
Sahel were represented as a tree diagram (TRD, page 74) 
and an oval diagram (OVD, page 81). The oval diagram 
showed the relationships among a set of variables which 
described the nomad pastoralist eco-system, and key eco- 
nomic and social variables such as the SOCIAL VALUE 
ON CONSUMPTION (see figure 5). Self-interaction 
matrices were constructed for the two parts of this dia- 
gram: the livestock-environmental and the population- 
socioeconomic variables (see figure 1, matrices A and C). 
In each case, the outside interventions (shown as boxed 
variables in figure 5) were diagrammed as separate 
matrices (Band D). 

The interaction matrix diagram provides a systematic 
way of examining the multiple interactions between an 
outside intervention and the internal system variables. 

The cross-interaction matrices AXB and CXD were 
constructed to determine which system variables were in- 
fluenced by the outside interventions (see figure 1). As the 
oval diagram indicates (figure 5), these interventions were 
originally diagrammed as affecting only a single system 


vanable. 
The cross-interaction matrix AXB was further specified 


by starting with the column DEEP WELLS and asking, for 
each row variable: Does this intervention (digging deep 
wells) influence this variable? Additional positive entries 
are shown in figure 6 as slashes in the cross-interaction 
‘natrix. 

In order to determine the possible influence of system 
variables on the intervention (i.e., mutual-causal relation- 
ships—see OVD, page 81) the BXA and DXC cross- 
interaction matrices* were constructed, and the entries 
for each row element (intervention) were determined by 


“Note that AXB and BXA are orthogonally linked matrices while 
BXA and BXCare linearly linked matrices. 
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the relationship test: Does this column variable influence 
this row intervention in the system? Positive responses are 
shown as slashes entered on the diagram (see figure 6). 

Subjecting the diagram to this systematic process re- 
vealed some omissions in the original conception of the 
complex eco-system relationships. For example, HERD 
SIZE CONTROL affected a number of other variables be- 
sides the HERD SIZE. One in particular which should not 
have been slighted is the necessity to influence the DE- 
SIRED HERD SIZE variable of the nomad pastoralist de- 
cisicn maker. Also, the crucial interaction between HERD 
SIZE CONTROL and RANGE LIMITATIONS is pin- 
pointed. Other interventions such as VETERINARY 
SEKVICES can be added to examine further interactions. 

The oval diagram may then have been redrawn to form 
the interaction matnx diagram to show these additional 
hypothesized relationships. 
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Constructing a Tree Diagram to Clarify Relationships 

Multiple relationships may be lost in the complexity of 
the matrix format. A simple way to clarify the diagram is 
to construct a tree diagram (TRD, page 74) of the inter- 
actions. A tree diagram is shown for the relationships of 
HERD SIZE CONTROL to other elements of the descrip- 
tion (see figure 7). The right-hand tree lists the factors 
which influence the intervention of HERD SIZE CON. 
TROL. The right-hand branches represcnt the positive 
entries in the column labeled HERD SIZE CONTROL. 
The left side describes variables which are influenced by 
this intervention. The left-hand branches are the entries in 
the row with the same label. 

Some items are duplicated on both lists, indicating that 
attempting to control HERD SIZE is a complex process 
involving feedback of variables such as HERD SIZE and 
GRAZING PRESSURE on range lands. 


FIGURE 6 


Revised Interaction Matrix Diagram Showing Influences on Interventions in System 
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FIGURE 7 
Tree Diagram Clarifying the Influence 
Relationships in the Interaction Matrix Diagram Example 


Variables Influenced Intervention Variables Influencing 
By Intervention Intervention 
HERD SIZE HERD SIZE 
RANGE FEED AVAILABLE PASTURE 
DESERTIFICATION PASTURE RECOVERY RATE 
PASTURE RECOVERY RATE GRAZING PRESSURE 
GRAZING PRESSURE ish SEASONAL RAINFALL 
DEEP WELLS HERD SIZE WATER AVAILABLE 
CONTROL 


RANGE LIMITATIONS 
DESIRED HERD SIZE 
FOOD SUPPLY 


YIELD FROM HERD 
INCOME FROM HERD 


The problems of the nomad pastoralists in the Sahel 
have been addressed using Interpretive Structural Models 
in two recent papers (Geiger and Fitz, 1976, and Horn- 
bach, et al., 1976). The papers present oval and tree dia- 
grams which were derived with the assistance of special 
computer programs designed to transfer the interaction 


matrix representations. 


THEORY 


The matrix representation of relationships takes many 
forms, and the relevant theory depends on the particular 


application. Beckett (1971) traces the representation ot 


systems from directed graphs (oval diagrams) to matrix 
models (interaction matrices) to Markov transition 
models. The latter builds on probability theory with the 
matrix entries representing the probability of a transition 
from one system state to another. 

Interaction matrix diagramming owes a great deal to 
the efforts of Warfield and others at the Battelle Memorial 
Institute (Hill and Warfield, 1972). Their “Unified Pro 
gram Planning’’ uses the self-interaction and cross- 
interaction matrix approach to structure the following 
sets of planning elements: 


RANGE LIMITATIONS 
DESIRED HERD SIZE 
CULTURAL NORMS: HERD SIZE 
YIELD FROM HERD 
SOCIAL VALUES: CONSUMPTION 


Constraints 

Needs 

Objectives (and measures) 
Alterables 

Agencies (and agents) 
Activities (and measures) 
Societal sectors 


These techniques and others are described in Portraits 
of Complexity (1975). 

Interpretive Structural Modeling is the label fora range 
of computer-assisted diagramming techniques which grew 
out of the work at Battelle (Warfield, April, September, 
1973; 1974). It relies on computer assistance to manipu- 
late the matrices of relationships into a model and pro- 
vides a powerful technique for automatically analyzing 
large numbers of complex interactions. The basis for com- 
puter assistance is found in the Properties of directed 
graphs and matrix Partitioning. These techniques may be 
performed manually, but are tedious for large matrices. 

Gerardin (1973) describes an application of the tech- 
nique to planning, and ata recent conference (IEEE Con- 
ference, 1976) 
development problems. 


several authors applied the technique to 


The interaction matrix diagramming technique ex- 
tracts the most useful elements of Interpretive Structural! 
Modeling and the more heuristically oriented Unified 
Program Planning. 
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V 
Analyzing 


Complex Processes 


Flowcharts 
Decision Tables 
Computer Simulation Models 
Gaming 


Project planning demands analysis of the complex processes of development. Static de- 
scriptions are useful for characterizing complex relationships, but dynamic analysis takes 
the description into the time dimension. A powerful technique for dynamic analysis utilizes 
the versatility of electronic computers (Computer Simulation Models) to examine the pro- 
cesses which bring about changes in systems. The computer is not an absolute requirement, 
as other means of simulation can be used to explore complex processes. Two analysis tech- 
niques (Fiowcharts and Decision Tables} focus directly on the sequences of decision and 
action which characterize sy stems performance. 


—s 


Flowcharts 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


A flowchart represents complex processes as a con- 
nected sequence of decisions and alternative actions. 


USES 

A flowchart is used to: 

1) Present the analysis of acomplex decision situation 
or procedure which can be broken down into identifiable 


Sy os: 
2; i ite a complex sequential process such as as the 


3) I Bay how a repetitive activity is to be carried 
out, e.g., the routine tasks in consoling project disburse- 


ments. 
4) Design, analyze, and ener computer programs. 


KEY DEFINITIONS 


1) A process symbol represents an action which takes 


piace over time (see figure 1). 


2) A decision symbol represents a step in a process 
where there is a choice among two or more alternative ac- 
tions (see figure 1). 

3) A state symbol represents a tangible product, re- 
quirement, or specific condition associated with a process 
sequence (see figure 1). 

4) A directed line links two symbols together with an 
arrowhead indicating the sequence (see figure 1). 


SHORT DESCRIPTION 
A flowchart consists of process, state, and decision 
symbols which are combined to show the sequence or flow 


of a complex process. The process may be the steps neces- 
sary to achieve a task, a series of decisions where choices 
are dependent on earlier choices, or the routing of infor- 
mation and materials in a system (see System Definition 
Matrix, SDM, page 67). 

The symbols are linked by directed lines to indicate the 
order of occurrence (see figure 1). If a decision has an al- 
ternative which requires the repetition of a process ¢ or de- 
cision, then the flowchart depicts the e feedback loop. 


ADVANTAGES 


1) Flowcharts are relatively simple to use and have 


wide applicability. 


2) The graphic description of acomplex process makes 


it easier to communicate with others. 


FIGURE 1 
A Flowchart for the Task of Constructing a Flowchart 
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3) Alternative courses of action are related to succes- flowcharting requires identification of distinct actions 


sive steps by their location on the flowchart. within the complex process or system. 

4) The position of an activity in the overall task is The decision symbol is another building block for flow- 
clearer than in prose descriptions. charts. It always contains a question like: 

5) Logical inconsistencies in decision sequences canbe 
identified, e.g., a portion of a computer program that can- 
not be executed because no action sequence leads to it. 


1) Dida particular event occur? 
2) Hasa specified criterion been met? 
3) Isa prior process complete? 


LIMITATIONS Question 1 is answered by a simple binary choice—yes 
Or no. These answers are associated with the arrows 


1) Constructing a flowchart may be ew “ee se . 
ee “6 "8 ari may b ies hat sia emitting from the decision symbol and leading to subse- 
cu an a simple pr nstru ; 
Pie prose account or the construction quent symbols in the chart. 


4 decision table (DTB, page 113). It is easier to pas a Question 2 may be answered by yes or no, or the spe- 

e a) Medifing to felon enn ES cific criteria may be shown as branches emitting from the 
flowchart decision symbol (see figure 2). 

choices may require redrawing the flowchart. Question 3 is a specific case of question 1 (the event is 


3) A flowchart is less effective _— analysis tool the completion of the prior step) and illustrates acommon 
where a large number of options are associated with a deci- occurrence in the flowchart. The branch labeled NO will 
‘gsi likely loop back to the prior symbol if the process cannot 
continue until that step is completed (see figure 2). 

The state symbol is an optional, though useful, compo- 
REQUIRED RESOURCES nent of flowcharts. It is used to identify the resources 

needed (inputs) or the result of a process (outputs). The 
LEVEL OF EFFORT state symbol can also indicate the state of the activity ata 
specified point in time, e.g., the conditions necessary be- 
fore disbursement of loan payments toa host country. 

A pair of connector symbols, often used in flowcharts 
cisions and processes. to promote clarity, permits breaking the line linking two 

symbols to avoid crossing lines or to connect portions of a 
flowchart on separate pages (see figure 1). The same letter 

SKILL LEVEL or number should be used in each circle. 
; ; ee Ns Any number of other symbols can be used in flow- 

Flowcharting requires the ability to anticipate the em ity bleak ween 1 tro 

‘ a charting as long as a suitable explanation of the signifi 
souperet the a ee and to break down the preleS niga cance of the shape is given. Otherwise, the different 
sequence of activities. Flowcharting becomes easier with symbols may fail to communicate a complex decision pro- 


Effort is expended in identifying possible decisions, 
determining the processes required to carry out the ac- 
tivity, and constructing a flowchart which links these de- 


practice. at. 
The Delta chart (described by Warfield and Hill, 1971) 


TIME REQUIRED de is a flowchart designed specifically as a planning and con- 

trol tool. It provides more symbols (e.g., logic elements) 

The time required depends on the number of activities and incorporates a larger amount of data (e.g., the person 

and the complexity of the sequence. A flowchart de- or organization responsible for a process and the time 
scribing a sequence of 100 stepsmay take approximatelya involved in carrying outa process). 


Cz ¥ to construct and refine for clarity. 


TOOL OUTPUT 

DESCRIPTION OF TOOL The flowchart is a planning tool that indicates how an 

activity can be carried out in the future. The planner may 

find the flowchart useful as a control tool if he identifies 

who is responsible for what process and if he specifies the 
timing of the processes. 

The flowchart provides a description not only for de- 

sign and analysis purposes, but for repeated use in the 

operational phases of a project. The operator follows the 


REQUIRED INPUTS 


Flowcharts are combinations of symbols: 

The process symbol describes an action or step in the 
overall process. The leve! of detail necessary to describe a 
process Cepends on how the chart is to be used (greater 


D: 
Cetail could lead to cluttering the diagram). Consequently, 
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FIGURE 2 
Examples of Decision Points for Flowcharting 


Interview 
next applicant 


(feedback loop) 


Determine 
farm size 


sequence of processes described and branches at each de- 
cision point according to the current conditions affecting 
the decision. In this regard, the decision table may be more 
useful than a flowchart (see DTB, page 113). 


IMPORTANT ASSUMPTIONS 


Flowcharts belong to a set of techniques which, even 
though allowing for various contingencies, assume that a 
fundamental determinacy underlies the diagrammed pro- 
cess. There is an underlying logic or basic rationality which 
must hold for the process. Otherwise the combination of 
decisions, actions, and states is meaningless. 

This feature of flowcharts suggests their use in testing 
the logic and coherence of a prose description of a com- 
plex process. If the charted sequence does not “flow” 
logically, then perhaps the process being described is in- 
coherent or inconsistent. 


METHOD OF USE 


GENERAL PROCEDURE 


Constructing a flowchart is primarily a heuristic task: 
only general guidelines can be given. Be careful not to get 
bogged down in details: rather, start with a high level of 
abstraction to capture the basic processes and major de- 
cision points. The first chart should give a broad repre- 
sentation of the overall process. More detail may be added 


IN successive versions. 


Have all 
applicants been 
interviewed? 


How many 
hectares does the 
farmer own? 


Select candidate 


Less than one 
~~ 


One to three 


More than three 


The following steps are useful guidelines for describing 
a complex process which follows a more or less logical se- 


quence from start to finish. 


1. Identify major processes and decisions. 

2. Single out those processes (and decisions) which 
represent the basic activity accomplished. 

3. Order these in a sequence of successive symbols and 
sketch the basic flow by showing only the connections 
which represent the most likely choice at each decision 
point. , 

4. Idenafy the conditions which must be met before 
each decision can be made and connect them by arrows 
entering the flow before the decision point. 

5. Identify the alternatives at each decision point and 
show these as labeled branches emitting from the decision 


symbol. 
6. Rather than show a symbol for a process which 


must be repeated, loop back to the symbol representing 
the first occurrence of that process. 

7. Examine the chart for consistency, 

8. If further detail is desired, break the processes into. 
subprocesses and insert additional decision points as re- 


quired. 


If the complex process is primarily a series of decisions, 
then the ordering in step 3 should reflect the logic of the 
questions asked, e.g., from general to specific, or ina selec- 
tion process, those decisions which lead toan early accep- 
tance or rejection, e.g., minimum qualifications which 
must be met for job applicants. 
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EXAMPLE 

The degree to which the public reacts to a plan which 
calls for public participation significantly affects the 
planning process and the ultimate course of action. 
Montgomery (1974) poses a series of questions which lead 
to three actions: 1) the government carries out the plan 
without public participation except as compelled by arbi- 
tration or adjudication; 2) the public participates in carry- 
ing out the plan; or 3) the plan is abandoned. Figure 3 pre- 
sents a flowchart of the questions for determining which 
alternative is likely to occur. 

Other examples may be found in the descriptions of 
Interaction Matrix Diagrams (IMD, page 92) and Scen 
arios (SCN, page 164). 


THEORY 


Flowcharts belong toa set of approaches for pictorially 
describing complex processes. Nadler (1970) describes 
many of these variations, all of which depend on the an- 
alyst’s ability to abstract complex decisions and opera- 
lions. This is a particularly useful skill for computer pro- 
grammers where the logical flow of calculations and data 
manipulation may be traced. 

The same idea may be used to describe any system or 
deterministic task. Signal flow graphs and networks are 
flowcharts with different symbols for representing the ele- 


ments (Whitehouse, 1973). Basic laws have keen de. 
veloped for simplifying these representations, thouch 
their application to flowcharts is more difficult. 

Decision tables have a one-to-one correspondence zo 
flowcharts (see DTB, page 113). This format for analyzing 
a complex process lends itself to certain principles of 


simplification (see Lewis, 1970). 
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ecision Tables 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


A decision table documents a decision-making process 
by describing actions to be followed under different con- 


ditions in a given environment. 


alee 
Decision tables are used to: ; 
1} Analyze complex decision situations~ 
2) Provide a documented procedure for handling de- 
cisions which may re-occur under different conditions. 


3: Record and communicate procedural rules and 


-e - 


regulations within Organizations. 

j Provide the basis for writing computer programs for 

use in tools such as Compute: Simulation Models (CSM, 
120:, 


‘ 


REY DEFINITIONS 

The condition srub is that portion of a decision 
bie which Lists the factors to be considered when making 
isions in a given situation. Each factor is written in the 


form of a question, e.g., “Are loan funds available?” 
2) The condition entries are the conditions of each 
factor (or question) listed in the condition stub, e4-, 


“YES —loan funds are available.” 
3) The action stub is that portion of a decision table 


which lists the actions or decisions to be taken if a partic- 
ular combination of circumstances occurs, e.g., “submit 


fund transfer request.” 
4) The decision rules are the action entries of a deci- 


sion table which link a particular combination of condi- 


tion entries to specified actions. 


SHORT DESCRIPTION 


A decision table is a tabular representation of a com- 
plex decision process where a number of factors affect the 
choice of action(s). The table has four parts: the condition 
stub, the condition entries or contingencies, the action 
stub, and the action entries or decision rules (see figure 1). 
The table is used by first determining the conditions which 
apply (e.g., loan funds are available, but the government 
has not deposited its contribution), and then by matching 
the condition entries to this contingency to determine the 
decision rule column (e.g., column 2). The actions to be 
taken (or the decision choices) are indicated by X’s in the 
column. The ‘‘X” may be interpreted thusly: If these 
conditions occur, then these actions are specified. 

Decision tables may be interconnected to present com- 


plex sequential decision processes, 


114 / ANALYZING COMPLEX PROCESSES 


FIGURE 1 


Decision Table Used by Donor Agency for Depositing Loan Funds into Special Program Ace 


CONDITIONS 


iS are — -o OP Ee ee 
Are loan funds available? NO YES 
Has government contribution been deposited? ee era Yes 
Has release of funds been authorized by government? = a NO ¥ES : 
Submitfundemfireegues. dT oe Pd 
> me Xoall 


Resolve constraints with Ministry. ts hy 
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ACTION 
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ADVANTAGES 

1) Decision tables are a concise method of describing 
situations. 

2) Standard techniques are available to ascertain that 
there are no omissions or inconsistencies in the table. 

3) Decision tables aid in understanding and com- 
municating complex situations. 

4) The decision table is easily adapted for computer 
programming. 

5) A complex decision involving several factors (each 
of which may assume multiple values) typically requires a 
specification of a different action for each combination of 
factor values. This process is more easily represented ona 
decision table than by a prose description or a flowchart 
(see FLW, page 107). 


LIMITATIONS 


1) A flowchart has greater visual clarity for under- 
standing the different courses of action in a complex pro- 
cedure. 

2) Decision tables are relatively little used and may 
deter the uninitiated un til che mechanics are mastered, 


REQUIRED RESOURCES 


LEVELOFEFFORT 


Etfort is required to iden tify the different conditions in 
a situation and the actions to be taken when specific con- 
Gitions occur. Developing the table requires little addj- 
tional effort, 


ounce 


DECISION RULES 


YES YES 
NO Yes 


ENTREES 


CONDITION 


ACTON 
Eas COTES 


“Special Segregated Program Account for disbursement of funds to programs. 


SKILL LEVEL 
The ability to logically break down a decision into rele. 
vant factors and decision rules for action is fundamen-al to 


constructing decision tables. Their use requires lirle sxill 


once the format is understood. 


TIME REQUIRED 


The time required to develop a decision table depends 
on the complexity of the decision situation. Less than an 
hour is required to develop a decision table with 5-8 condi- 
tions, 8-10 actions, and 10-15 rules. Additional time is re- 
quired if several interconnected tables are needed to de- 


scribe the situation. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) A limited entry decision table permits only a 
limited set of condition and action entries in the decision 
rule columns, €.g., YES or NO (see figure 1). 

2) A mixed entry decision table permits extended 
entries such as a range of values for a question, ‘Whar ‘s 
the size of the land holding?” in the coadition stub, 

3). The £L6Bsméleis a columa in the decision table 
which applies when no other decision rules may be added 
Co cover the case or where no combination of conditions 


applies. 


REQUIRED INPUTS 


Construction of 3 decision table requires a breakdown 
of the factors relevant to the decision and the possible 
action choices. The analyst must consult with the deci- 
sion maker on policy and conditions affecting the policy 
if the table is to be used as a guide for action. 


TOOL OUTPUT 


The decision table technique results in an analysis of 
the conditions and actions which compose a particular de- 
Process may be valuable in itself to point out 


cision. The 
e further specifi- 


inccnsistencies in procedure or areas wher 
cation of action is in order. 


IMPORTANT ASSUMPTIONS 


The decision table technique assumes that the decision 
process can be rationalized, and thus actions are pre- 
specified. All relevant conditions must be identified a 
Priori, i.e., all the actions which follow from a given set of 
conditions can be specified. The implication of a pre- 
programmed automatic response is somewhat counter- 
acted by including an ELSE rule in the set of decision 
rules. This permits an escape clause if none of the relevant 
conditions hold, or if the analyst chooses not to specify 
every possible combination of circumstances. The action 
for the ELSE rule is almost always to call it to the atten- 
tion of a supervisor or higher level decision-making 


authority. 


METHOD OF USE 


GENERAL PROCEDURE 


Constructing a Limited Entry Table 
1. Fill in the condition stub of the table (upper left quad- 


rant). 
1.1 Determine the conditions which are relevant to 


the decision. 
1.2 Write each condition in the form of a yes/no ques- 


ton. 
1.3 List the conditions in the condition sub. 


2. Fill in the action stub of the table (lower left quad- 


rant). 
--i Determine the action options which correspond to 

each possible combination of conditions. 
2.2 List the actions in the action stub. 
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3. Specify all possible conungencies (upper right quad- 
rant), 

3.1 Enter a YES or NO to the first condition 
simply Y or N) inthe table at the first rule column 
(see figure 1). 

If the other conditions are relevant, enter a YES or 
NO for each remaining condition in that column; 
if not, entera “—”. 

Repeat this for the remaining columns until all 
possible combinations of conditions are marked. 
Each combination represents a contingency and 
occupies a single column in the table. 

Confirm that if there are n questions in the condj- 
tion stub, then there are 2" con tingencies (unless 
some combinations are not feasible). 


(or 
Jue 


ke 


3.4 


4. Enter the decision rules (lower right quadrant). 


4.1 Start with the first contingency (column 1) and 
indicate the appropriate action with an X at the 
intersection of the column with the corresponding 
action row, 

Repeat this process for each contingency until all 
columns have at least one en try in the bottom por- 
tion of the table. 


4.2 


5. Simplify the table if possible. 


5.1 Order the decision rules from left to right so that 
the rule which is indifferent to the most number of 
conditions is the first decision rule column. 

Order the condition questions so that the decision 
rules are applied first to the contingency where the 
least number of questions must be asked. Steps 5.1 
and 5.2 should result in the condition entries oc- 
cupying the upper right triangle with an increasing 
number of indifferent entries ( —) in the lower 
left portion (see figure 4}: 

Combine any two decision rule columns which dif- 
fer only by the answer to one condition question 
and mark the entry as indifferent, since the choice 
of action will not be affected. 


aie 


5:3 


Constructing an Extended Entry 
or Mixed Enery Table 
Extended entries permit more flexibility in the formu- 
lation of conditions and decision rules. Otherwise, the pro- 
cedure is the same. For example, step 1.2 requires only 
that the question be posed in such a way thata finite set of 
conditions can be written in the contingencies portion of 


FIGURE 2 
Flowchart of Interpolation Procedure to Determine Internal Rate of Return 


Select trial r 


Determine NPV 


Increase rby 


5 or 10% 


Determine 
new NPY 


POSITIVE 


What 
is the sign 
of NPV? 


Decrease r by POSITIVE 


5 or 10% 


Determine 
new NPV 


NEGATIVE 


NEGATIVE 


What 
is the sign 
of NPV? 


What 
is the sign 
of NPV? 


Sum absolute values 
of NPV and previously 
computed NPV 


Divide NPV which 
is positive by sum 
(from previous step) 


Compute difference between 
trial rand previous trial r 


' Mulciply difference times 
quotient computed in step 
two steps previously 


ABBREVIATIONS 


IRR: internal rate 


of return 


Add this product to the 
lower of the two discount rates 


NPV: net present value 


r: discount rate 


Sequence of Steps 


the table (e.g., farm size in hectares), Furthermore, the de- 
cision rule entries need not only refer to the action row, 
but may indicate: 


1) A further specification of the action, such as the 
quantity of fertilizer to be distributed. or 
2) Instructions to go to another Step or to another de- 


cision table. 


A column may be added which includes all con- 
tingencies not otherwise described. This ELSE rule js to be 
followed when none of the combinations of conditions 
apply. 

A mixed entry table combines limited entry symbols 
(¢-g.. Y, N, X) with extended entries. These may includea 
decision rule to go to another decision table if a particular 


contingency occurs or the ELSE rule. 


EXAMPLES 
Limited Entry Decision Table 

A czpital projects development officer for a major 
donor agency wanted to ensure that funds released by his 
agency were matched by the required ratio of funds from 
the host government.” The government had failed to con- 
tribute their share of funds in the past. Often, when the 
required funds were budgeted, they were later diverted to 
other programs. 

In order to exercise more control over the use of the 
donor's funds and the requirement for cost-sharing by the 
government, a Special Segregated Program Account 
\SSPA?} was established. The donor agency mission would 
then deposit and release funds if the Ministry of Finance 
had fulfited its obligations. A limited-entry decision table 
was prepared to guide the disbursement policy (see figure 
1}. 
Tne decision table was arranged so that the capital de- 
velopment officer need not examine the other conditions 
unless the necessary initial conditions occurred, e.g., loan 
funds are available. 

Mixed Entry Decision Table 
ting the internal rate of rerirn (IRR) for a pro- 


Cor. p: 
ject is an iterative process: the discoznr rate, r, must be 
ai . . o : he 
found which gives a net present value. \PI", equal to zero 


‘see Interna! Rate of Return, IRR, pace 200). However, if 
ene has computed both a positive ‘NPI*,) and negative 
net present value using two different rial dis- 


rie Ges ) an 
rhs } 

"Tris @xarp.e is Som a ctor prac: by Ted Foley, “Svstems 
Aeercashe: te Integrates Roral Devesemen: Proosm," Develop- 
mene ereces Pscpam., USAT) wate ss.. .C., 1$76. 
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count rates, ry andr, respectively, the IRR may be inter- 
polated using the following formula: * 


NPV, 


IRR =r, +(rz -r,)X 
(NPV, -NPV>) 

The steps necessary to calculate the IRR can be repre- 
sented as a flowchart (see figure 2). Recouching this pro- 
cedure in the decision table format requires the combina- 
tion of a sequential procedure with an iterative process. 
This may be necessary in order to get both positive and 
negative NPVs (see figure 3). 

The ELSE rule was employed where the NPV deter- 
mined from a trial ris zero, in which case the IRR equals r. 

The decision table (figure 3) isa mixed entry table be- 
cause the iterative actions include extended entries. 

An illustration of interpolating the IRR for a project 
cash flow is given in the technique description (IRR, page 


200). 


THEORY 


Decision tables belong to a class of techniaues which 
are categorized as logical trees or algorithms (Lewis, 
1970). The underlying idea is the linking of contingencies 
(combinations of conditions) with the appropniate action 
according to a set of prespecified decision rules. The deci- 
sion table has a one-to-one correspondence with a flow- 
chart (see FLW, page 107). Each rule in the decision table 
corresponds to a path in the chart. Decision tables may be 
simplified by applying certain rules of logic so that, if the 
same actions apply, it is usually unnecessary to show every 
sequence of alternatives or every combination of condj- 
tions. This is treated in more detail in Fergus (1974), 
Hartman (1968), and McDaniel (1970). 

Extended entries add more flexibility to the decision 
table, but they require more care in construction. Nadler 
(1970) and Pollack, et al. (1971) give more information on 
the technique. 
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*This equation is adapted from J. Price Gittinger, Feonomic 


Analysis of Agricultural Projects (Baltimore: The John Hopkins 


Universit, Press, 1972), page 80. Note that the denominzzor on 
the right is the sum of the absolute values of the positive and nega: 
tive NPI’s. Gittinger suggests that the difference berween r, and 


andr, 
; 


be 5% or less. 


FIGURE 5 
Mixed Entry Decision Table for Determining 
Internal Rate of Return by Interpolation 


1. Select trial r 


2. Determine NPV 
3. What is sign of NPV? om 


mal 
= 

ie 

n 

z 

= 4, Determine new NPV 
fa) 

= 

S 5. What is sign of NPV? 


6. Determine new NPV 


Iterations undl NPV 
changes sign (or. is zero) 


ACTION STUB 


8.Sum the absolute values 
of NPV and previously 
computed NPV 


- Divide NPV which is posi- 
tive by sum computed in 
step 8 


-Compute difference be- 
tween this trial r and pre- 
vious trial r 


-Compute product of dif- 
ference and quotient 
computed in step 9 


. Add this product to lower 
of the last two trial dis- 
count rates 


- Result is the IRR 
NOTE: r = discount rate: IRR = internal rate of return; NPV = net present value. 
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Computer Simulation Models 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
Computer simulation models simulate dynamic system 
Processes in order to analyze complex interactions, 


USES 


Computer simulation is used to: 

1) Forecast future systems behavior. 

2) Forecast the effects different decisions have on 
system variables. : 

3) Aid in understanding system processes, 

4) Be used in tools like Gaming (GAM, page 124), 

5) Compare alternative system behavior or determine 


Optimum system design parameters. 


KEY DEFINITIONS 
1) A system is a collection of components which in- 


feract to achieve acommon function. 
2) A variable is a factor word to describe a system 


which may change value asa function of time. 


3) A parameter is a quantity with only one value over 
the entire range of the system behavior being simulated. 
The distinction between 2 Parameter and a variable is 
sometimes only a matter of degree of change. In the 
model, the Parameter is assumed not to change during the 
course of a particular simulation, e.g., ‘the price of zold” 
may be a parameter in an economic system. 

4) Verification is testing a computer simulation pro- 
gram to see that the program functions as intended. Iris a 
Process of eliminating logical errors in the program. 

5) Validation is testing whether a computer simulation 
Program simulates the observed system behavior. It is a 
Process of simulating the past and checking the simulated 
data against actual data. 


SHORT DESCRIPTION 


A computer simulation involves: 

1) Developing a model of the simulated system. 

2) Programming the model in a computer. 

3) Verifying the internal consistency of the model. 

4) Validating the model by comparing it with observed 
system behavior. Past and Present data are needed in gl] 
stages of computer simulation, 

Computer simulations are exploited by changing para- 
meters to correspond with expected changes in the sys- 
tem. Present and future System behavior is then inferred, 


ADVANTAGES 


1) Computer simulation is useful for problems which 
cannot be studied analytically. Typically, problems neces- 
sitating computer simulation involve detailed models of 
complex systems with non-linear and probabilistic be- 
havior. 

2) Systems which require expensive or impractical ex- 
perimentation may be simulated in a computer. For ex- 
ample, the performance of a dam or reservoir can be 
studied using a computer simulation rather than by build- 
ing different dams. 

3) A wide range of alternatives can be studied, since 
changing com puter models is relatively fast and easy. 

+) Complex assumptions can be easily incorporated 


into a computer model. For example, in a macro-eco- 


nomic model, a wide range of assumptions, including 
those about price stability, exchange rate, limitations of 
natural resources, and climatic catastrophes, can be in- 
corporatedin a simulation model. 

S) Computer simulation may provide insight into the 
causal structure of the system by revealing dynamic be- 


havior. 


LIMITATIONS 
1) Data may not be available to construct and/or testa 


computer simulation model. 
2; Computer simulation models may become so com- 


plex that assumptions are hidden and the ability to infer 


underlying sy stem processes is lost. 


3, Developing large computer simulation models is 


time-consuming. Verifving and validating entire models 
are often difficult. 

+, A computer simulation provides only a specific in- 
stance of system behavior. Generalized inferences do not 
always follow. 

5; Conclusions derived from a computer simulation 
zré only as reliable as the model upon which the simula- 
tion is based. The user of the results may forget that the 
model is an abstraction based on the developer’s assump- 
tions. Too much weight may be placed on the results and 


conclusions because they are quantified. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 
i ‘fc: 
Gathering data, developing a model. and verifying and 
‘aiideting the computer simulations are necessary. Using 
computer simulation languages will often re- 


A 


specialized 
ce che amount of effort involved. 


h 


C: 
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Techniques are available that aid in developing models 
for computer simulation: Oval Diagramming (OVD, page 
81), Interaction Matrix Diagramming (IMD, page 92), 
and Decision Tables (DTB, page 113). 

Several computer languages also simplify the process, 
e.g., DYNAMO, GPSS, and GASP (see Gordon, 1969). 


SKILL LEVEL 


Knowing about the system being simulated is required, 
An analyst must have the computer usage skills and the 
basic statistical knowledge needed to develop and use 
computer simulation models. 


TIME REQUIRED 


Time required depends on the number of ‘variables in- 
cluded in the model and the availability of data. Typically, 
developing the model may take a weck; programming the 
model may need another week; verifying and validating 
the model take a third week. However, the complexity of 
the system model (number of variables and relationships) 
will greatly influence the time it takes to develop, verify, 
and validate the model. Testing alternatives by simulation 
May require several runs or it may continue for the dura- 
tion of the project. These estimates assume that the data 
required are easily available. Additional time may be 
needed if Surveys (SVY, page 36), Questionnaires (QTN, 
page 19), or other tools have to be used to obtain data. 


SPECIAL REQUIREMENTS 

Access to a digital computer is necessary. Many spe- 
cialized simulation languages may be used successfully on 
a remote computer terminal using purchased computer ac- 


cess time. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) Tuning is the process of making changes in the 
parameters and initial values for variables in order to mini- 
mize the errors between expected and actual simulation 
output or the errors between observed or simulated data. 

2) A continuous model treats variables that change 
continuously over time, e.g., population. 

3) A discrete stochastic model describes the changes in 
variables at definite points in time, e.g., money supply 
increases on the day the Federal Bank releases notes. 
Often, the time interval between these points in ame 


varies randomly. 
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REQUIRED INPUTS 

The purpose for simulation must be stated before a 
simulation can be developed. Data necessary for modeling 
the system and for validating results are required, though 
the data need not be gathered until variables and param- 


eters are defined [fa particular programming language is 
preferred, a compatible computer must be available. 


TOOL OUTPUT ; 
The results from computer simulation models include: 
1) A computer simulation model of the system under 


question. 
2) Forecasts of system behavior under different as- 


sumptions (e.g., alternative parameter values). 
3} A better understanding of the system and its be- 


havior. 


IMPORTANT ASSUMPTIONS 

All the relevant variables ard relationships can be quan- 
titled and all necessary data are available. It is assumed 
that all variables and relationships can be identified and 


defined explicitly. 


METHOD OF USE 
GENERAL PROCEDURE 


Computer simulation cannot be described fully with- 
out reference to a specific type of model or a particular 
application. The following outlines only the steps basic to 
all computer simulations. 


1. Define the problem. 
1.1 Recognize the system problem. 
1.2 Identify the system boundaries. 
1.3 Observe current and past system behavior. 
1.4 Formulate problem objectives. 


2. Develop the descriptive model. 
2.1 Identify the important variables and the cause- 
effect relationships in the system. 


2.2 Identify the parameters of the system. 
2.3 Select the type of model to be developed. 


2.4 Develop the model to represent system behavior. 


Two types of models will be discussed: 

1) The continuous model where the change in the vari- 
ables is expected to occur continuously (see Forrester, 
1969). Computer languages like DYNAMO can be used 


here. 


2) The discrete stochastic model where the change in 
the variables is expected to occurat specific points in time. 
These models are very popular in simulation. Many lan- 
guages, including GASP and GPSS, are available for this 
model. 
The model of system behavior may be traced througn 
Flowcharts (FLW, page 107), Oval Diagramming ‘OVD, 
page 81), Decision Tables (DTB, page 113}, cr 
Interaction Matrix Diagrams (IMD, page 92). 


3. Computerize the model. 
3.1 Select a programming language. 
3.2 Program the model. 
3.3 Verify the model. 


4. Validate the model using observed system daia. 
4.1 Tune the simulation model to correspond with 
past system behavior. 
4.2 Design experiments to test parameter values. 
4.3 Analyze the results of the experimental simula- 
tion. 
4.4 Statistically compare results with observed data. 


5. Simulate and infer, 
5.1 Express policies or decisions as changes in para- 
meter values or in some structural relationships. 
5.2 After making these changes, simulate the system 
model behavior and forecast the effects of these 


changes. 


EXAMPLE 


Continuous system models have been used by Forrester 
to model urban dynamics (1969). The Club of Rome has 
developed a model of the world predicting major changes 
in population, economy, etc. (Meadows, 1972). 

Discrete event simulation has been used in a large and 
complex model of Nigerian agriculture (Abkin and 
Manetsch, 1973). Some 22 alternate policies and Strategies 
were tested using this model. 


THEORY 


There are many types of simulation models that can be 
used. However, the types discussed above are the most 
popular and most widely used. Analogue computer simu- 
lation, where variables are represented analogously by 
currents and voltages in an electronic system constructed 
to resemble the observed system, can also be used. Also 
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used are more complicated continuous models that in- 
clude variables which are probabilistic in nature. Forrester 
(1968) discusses such models. 

The use (and misuse) of large computer simulation 
models for urban problem solving is treated extensively by 
Brewer (1973). Standard textbooks on simulation 
methodology include Gordon (1969) and Emshoff and 
Sisson (1970). 
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Gaming 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


Gaming provides decision makers with experience ina 
simulated problem environment in order to analyze com- 


plex processes. 


USES 

Gaming is used to: 

1) Generate possible alternative actions ina problem 
situation (operational gaming). 

2) Forecast effects of alternative actions, 

3) Train present and potential decision makers (man- 
agement gaming). 

4) Provide experience in using different tools that as 
sist in decision making, such as Contingency Analysis 
(CGA, page 147), Scenarios (SCN, page 164), and Com- 
puter Simulation Models (CSM, page 120), 


KEY DEFINITIONS 


1) The problem environment is the set of variables and 
relationships which are germaine to the decision process 
under study, 


2) Governing rules describe the relationships between 
decisions made by the participants and the resulting 
changes in the simulated environment. For example, in an 
economic game a governing rule may dictate that a deci. 
sion to expand money supply leads to inflation. 

3) Scoring in games is used as feedback to the partici- 
pants to reflect the effectiveness of their decisions. Scores 
are usually related to the objectives of the game. For ex- 
ample, “overall growth rate’’ may be used as a scorein an 


economic game. 


SHORT DESCRIPTION 


Gaming consists of acontrolled situation where people 
or teams compete either against each other and/or against 
a simulated problem environment to attain predetermined 
objectives. Games include a problem environment, several 
governing rules, and scoring, all of which are designed to 
represent a real situation. In games where two or more 
teams are participating, one team’s decisions influence 
other teams’ reactions and decisions. A single team may 
compete against a problem environment in which one or 
more variables are beyond the team’s direct control There 
are programmed relationships between the players’ deci- 
sions and the resulting changes in the environment. How. 
ever, the nature of the relationships is usually not known 
to the participating teams, and thus Participants become 
involved in analyzing complex processes. 


ADVANTAGES 


1) Decision makers gain experience without 
the real-life penalties for wrong decisions, 

2) A game can be designed to be very flexible and can 
provide a wide range of problem situations. 

3) Because the time element is limited, the player can 
make as many decisions ina few hours as he would make in 


paying 


a few years in real life. 

4) Gaming helps everyone involved, including the ana- 
lyst who designed the game, tounderstanda problem. 

5) Games have been developed for typical problem en- 
vironments and can be applied directly. The American 
Management Association provides alist of such games. 


LIMITATIONS 


1) Games representing large and complex real situa- 
tions may be difficult to construct. 

2) A game requiring four to fifteen hours requires con- 
siderable concentration from the Participants. 

3) Tke compressed time element in a game may mis- 
lead the decision maker as to the real nature of the dy- 
namic change in the problem environment. 

4) Governing rules in a game reflect the designer's 
knowledge and experience in the problem situation and 
thus are a limited representation of reality. Often novel 
approaches, which may be appropriate in real life, work 
poorly in games, stifling the decision maker’s creativity. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


A considerable amount of effort is required to develop 
a geme for a problem situation. A moderate amount of ef- 
fort is reguired from the Participants. Some elaborate 
game situations may use analysts and staff assistants as 


- 
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perticipants to assist the decision maker. 


SKILL LEVEL 

Developing a game requires expertise, primarily in the 
problem environment being simulated. Complex games re- 
ouire 2 team of experts. For example, developing a game 
for national economic policy making may require econo- 
mists to develop the governing rules, psychologists and 
eCucators to desien the format of intermediate results, 
omecter specialists to automate the game, etc. 
The skills required for playinga game are minimal when 
fcr training purposes only. If the came is used to gen- 


a:termative actions and forecast their effects, an ex- 
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rerenced decision maker needs to participate. 
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TIME REQUIRED 


The time required to develop a game depends on the 
complexity of the environment being simulated and on 
the amount of detail required. It also depends on the num. 


_ ber of participants. Generally, a few weeks are necessary, 


A typical session of game play may vary from two 
hours to eight or ten hours. Occasionally, games are played 
over a period of two or three days, 


SPECIAL REQUIREMENTS 
Games may be played on a digital computer (see Com. 
puter Simulation Models, CSM, Page 120) so that the pro. 
grammed relationships are automated. In this Case, access 
to computer facilities, including a remote terminal, is 


required. 


DESCRIPTION OF TOOL 
REQUIRED INPUTS 


Before the actual playing of the game, there are two 
stages of preparation: 

For the design of a game: 

1) Definition of the problem area, €.g., agricultural 
development programs, 

2) Statement of the Purpose, e.g., to consider the ef. 
fect of alternative Programs or to train area extension ser- 
vice agents. 

3) A design team (as specified in Skills section) should 
be distinguished from the Participating team. 

For the playing of a game: 

4) Specific starting values of variables. 

5) Commitment from the players. 


TOOL OUTPUT 

Effects of alternate decisions on the simulated envi- 
ronment are obtained, e.g., in an agricultural program 
game, the “effect of distributing free fertilizersled tomis 
use of fertilizers and low productivity,” while the “effect 
of increasing number of extension agents and subsidizing 
fertilizers led to higher productivity.” This leads to a 
greater understanding of the complex processes described 


in the gaming situation. 


IMPORTANT ASSUMPTIONS 


Games are used with an implicit assumption that the 
decision makers obtain an understanding about the prob. 
lem environment when they participate. This assumption 
is often challenged. Some educators believe that partici- 
pants learn only by reacting to the changes in the simu- 
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lated environment and do not try to understand the rea- 
sons for the changes. If this is true, games can have a detr+ 
mental effect on a participant’s decision-making ability. 
However, this can be avoided by supplementing the game 
with lectures or literature about the problem environ- 


ment. 


METHOD OF USE 
GENERAL PROCEDURE 


1. Design the game. 

1.1 Identify the specific purpose of the game. 

1.2 Identify how a game will help meet the purposes. 
See if there are any games currently available thar 
will meet the purpuses (sce Advantages). 

1.3 Identify the decision-making level of the partici- 
pants. A game designed for top management may 
be unsuitable for su pervisor-level participants. 

1.4 Identify the nature of decisions that a participant 
must make during game play. 

1.5 Decide how many teams the game involves and 
whether the game required the use of a com- 
puter. 

1.6 Outline a model of the environment (see Tree 
Diagrams, TRD, page 74; Oval Diagramming, 
OVD, page 81; and Interaction Matrix Dia- 
gramming, IMD, page 192). Identify important 
variables in the environment and establish the 
relationships between them in order to deter- 
mine the relationship between the decisions 
made by the players and their effects. . 

1.7 The time period of these relationships must be 
determined. This period depends on the nature 
of a game and the decision-making level (stra- 
tegic, Operational) of the Participants. For ex- 
ample, the time period could be a week when the 
participants are to schedule nurses in arural area. 
On the other hand, the period would bea year if 
the Participants are to plan for national develop 
ment. 

1.3 Determine the format and content of the inter- 
mediate results to be presented to the partic 
pant. In a computer assisted game, the interme- 
diate results will be the computer print-out. This 
should be designed to provide sufficient informa- 
tion for participants to make further decisions 
and to be realistic, ie., it provides only the type 
of information that can be obtained in real sirua- 
tions, 

1.9 If necessary, repeat 1.6 through 1.8 torefine de- 
cails of the model. The players’ instruction man- 
ual must then be written, outlining the necessary 


instructions for playing the game. The desizn of 
the game itself should be documen:ed secaracely 
for subsequent review if necessary. 


est the game and the instructor manual Using 
' 
>» 


trial sessions, This may reveal any errors in the 

computer program if one is used and any other 
- 

limitaticns of the game. 
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. Play the game. 


Introduce the participants to the simulazed -rob- 
lem environment and familiarize therm ‘wich 
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type of decisions they are required to mike. 


cope 


insuction manual for the game shoud cover 
this. 

Start tie Zalhiec session by Zlving ialitai ‘wieieew LU 
the variables in the game. For example, popula- 
tlon, men-women ratio, and fertility rate may be 
variables initialized ina “‘demographic game.” 
Point out thar che Participants are required to 
meet some ovjectives during game plex. Ex 
amples of objectives may be “reduce porulation 
growth to zero,” and “increase per capita au ci- 
tion.” 

Let the participants play the game. 

Determine the final results of the game—usually 
some measure of participant performance. The 
effectiveness of alternative decisions in meeting 
the objectives can be seen from the final resulss. 
These results can be used to make real decisions. 
The final results can also be used to evaluate the 
participants if the purpose of the game was train- 
ing. An optional (but often useful) conclusion to 
the gaming exercise is to permit the participants 
to freely discuss the game and their Participation. 


EXAMPLE 


Helmer and Quade describe an approach tothe study of 
a developing economy using operational gaming (Quade 
and Boucher, 1968, pages 329-33). They discuss using 
games to analyze the processes of development and the 
involvement of various experts in the excercise, 


Other examples of games applied in a variety of situa- 
tions can be found in Helmer, 1972, and Kibee, 1961. 


THEORY 


Gaming is described in the literature as Management 
games, computer simulation games, and Operational games 
\s€e Quade and Boucher, 1968). Operational games at all 


levels are used for training as well as for assisting decision 
making, particularly in Defense Department applications 
(e.g., war games). 

In industrial situations, Management games are used to 
aid in production planning, scheduling, marketing, and 
long-term planning. 

In the public sector, operational games are used to aid 
in making decisions, e.g., urban housing policies, mass 
transit decisions, and economic planning. 
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VI 
Accounting for 
Alternative Outcomes 


Histograms 
Subjective Probability Assessment 
Decision Trees 
Contingency Analysis 
a Ll 


Project planners must deal with uncertainty. Information must be aggregated into statis- 
tics which summarize the variability of the data. The likelihood of alternative outcomes 
must be estimated (Subjective Probability Assessment). Two techniques are specifically 
structured to enable the analyst to deal with alternative outcomes or contingencies (Deci- 
sion Trees and Contingency Analysis). Uncertainty is resolved in various ways, but all of the 
tools attempt to givea project designer a grasp on the indeterminacy and inherent variability 
of development processes. 


Histograms 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
Histograms diagram alternative outcomes which permit 
the inspection of characteristic patterns and the quantifi- 


cation of sariple statistics, 


USES 

Histograms can be used to: 

1) Show the frequency of the values of a discrete vari- 
a5le, such as categories of responses ina question. 

2) Graph the frequency of continuous variable values 
within consecutive discrete intervals, e.g., a profile of 
income distribution for farmers. 

3) Indicate the range of the variable. 

4+) Suggest a central tendency of the variable. 

5) Summarize responses from a sample survey (SVY, 


page 36) or Delphi (DLP, page 168). 


ne? DEFINITIONS 
1) The central tendency is the most likely, or average, 


value of the variable. 
2' A sample statistic is a quantitative parameter which 


characterizes some aspect of the population from which a 


set of data is drawn. 
3) A continuous variable takes on an infinite number 


of values over some range of possible values, e.g., the 
temperature measured at a fixed location at different 
times, or measured simultaneously at various locations. 

4) Adiscrete variable has only a finite number of values 
which are multiples of a basic unit, e.g., the numbers of 


members in an Organization. 


SHORT DESCRIPTION 

A histogram plots the frequency with which different 
values of a variable occur (see figure 1). If the variable is 
discrete, the histogram may be a series of bars centered 
over each value. If the variable is continuous over some 
fixed range or if discrete values are grouped, the histogram 
is a series of steps which correspond to fixed intervals of 


the variable. 


ADVANTAGES 

1) A histogram provides a clearer description of data 
patterns than a simple tabulation of the values. The length 
of the bar transformsa frequency distribution into a linear 


measure. 
2) Sample statistics may be shown directly on the hori- 


zontal scale of the variable. Gross errors in computation 


can be identified by inspection. 
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FIGURE 1 
Sample Histogram for Raw Data 
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Mean = 251/60 = 4.12 
Standard Deviation = 2.70 
Median = 3 

Mode = 2 
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VARIABLE VALUE 


LIMITATIONS 


Histograms may be misleading if the observation of the 
frequency is over too shorta time or includes too few mea- 
surements, or if the variable intervals are too large. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


Assuming the data are at hand, the effort required is a 
function of the number of discrete values or intervals. 


SKILL LEVEL 


Judgment is necessary to mark off the scale for the van-- 
able (e.g., the range and number of intervals for a contin- 


uous variable must be specified to give the desired clarity). 
Computing statistics from frequency data requires simple 


algebra. 


TIME REQUIRED 
Histograms may be constructed quite rapidly, if the 
data are well organized. 


SPECIAL REQUIREMENTS 


A hand calculator speeds up computation, and many 
have been preprogrammed for this purpose. If data are 
stored on a general purpose digital computer, a frequency 
histogram can be generated with a minimum of complex- 


ity. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) The mean is the average value or central tendency of 


the data. 


FIGURE 2 
Histogram for Clustered Data 
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2) The mode is the value or class interval which occurs 


most frequently. . . 
3) The median is the value corresponding to the mid- 


point of the data points. 

4+) The standard deviation is the measure of the dis- 
persion of the data values about the mean. 

5) A class interval is a uniform division of the vari- 
able range. 

6) Clustered data are used to aggregate the data into 
fewer points for analysis and plotting. 


REQUIRED INPUTS 

The data giving the frequency distribution of discrete 
values of the variable are the only required input. The data 
may be the result of responses to a Survey (SVY, page 
36) or Delphi (DLP, page 168) questionnaire. If the vari- 
able represents a qualitative judgment, thena rating scale 
should be used (see RTS, page 29). 


TOOL OUTPUT 

The technique produces a frequency histogram which 
may include the mean, mode, and median of the data. To- 
gether, these constitute the analysis for reporting the re- 
sults of a survey or for feedback to Delphi participants. 


IMPORTANT ASSUMPTIONS 


Plotting measurements of a variable in a histogram isa 
straightforward mechanical process. Valid inferences 
about the general characteristics of the phenomenon re- 
presented by the variable depend on an assumption that 
the measurements are an adequate and unbiased sample of 
all possible values of the variable. For example, if the 
temperature at the Temasek International Airport was 
measured each day at noon, the resulting data would en- 
able inferences about midday temperature at that loca- 
tion. However, without different data, not much could be 
said about temperatures at other times or at other loca- 


tions. 


METHOD OF USE 
GENERAL PROCEDURE 


Frequency Histogram fora Discrete Variable 


1. Compute the range of the variable by tinding the dif. 
ference between the largest and smallest data values. 


2. Determine the limits of the histogram’s horizontal 


axis. 


10. 


11. 


2.1 Include the range of the variacle within the 
limits. 
2.2 Markoff the unirs on the axis of the graph. 


Decide if the data are to be grouped and how many 
groups are necessary to give the desired derail ‘from 8 


to 25 items). 


. Determine the class interval size by dividing the ranze 


of the variable by the number of groups desired. 


. Determine the frequency distribution of variable 


values within each class interval and tabulate (see fiz. 


-ure 2). 


Determine the limits of the vertical axis. 
6.1 Select an upper jimit which is at ieast as large as 
the maximum frequency computed ia step 5. 
6.2 Select a lower limit which is either zero or the 
minimum frequency computed in step 5. 


. Plot the frequencies above the center of each class in- 


terval of the variable. 


. Examine the plot to determine if the histogram shows 


the desired degree of detail. 
8.1 Expand the scale of the frequency axis if neces- 
sary. 
8.2 Change the size of the class intervals to change 
the corresponding frequencies. 


. Finish the histogram by adding connecting bars and 


labels (see figure 1). 


Compute the mean and standard deviation for raw 
(ungrouped) data. 

10.1 Enter the data values and their respective fre- 
quencies ina table (see figure 3). 

Compute the mean of the data series using equa- 
tion 1, figure 3 

Compute the difference of each datum value 
from the mean and tabulate. 

Compute the standard deviation (equation 2, 


10.2 
10.3 


10.4 
i figure 3). 

Indicate the mean value on the horizontal axis 
of the histogram (see figure 1). 


10.5 


Compute the median of the data series (optional). 

11.1 Orderall the data points in ascending value. 

11.2 Divide the number of data points by two. 

11.3 Use this number to determine the correspond- 
ing data pointin the ordered sequence. 


FIGURE 3 
Mean and Standard Deviation of Raw Data Values 
Difference Difference 


Datum 
Datum Value | From Mean Value Squared 
1 
2 
3 


SUM, = 


Mean = SUM,/Number of data points 


Standard Deviation = \/(SUM;/Number of data points) 


11.4 If there are an even number of data points, the 
median will be the average of the two data 
points which split the ordered sequence into 
two equal parts; otherwise, the median is the 
midpoint in the sequence. 

The median value may be sketched on tne nisto- 
gram (note that this does not necessarily corres- 
pond to the mean value). 


£15 


12. Determine and mark the mode(s) of the histogram by 
determining the variable value (or interval) which oc- 
curs most frequently (optional). 


13. Compute the mean of grouped data. 
13.1 Enter the upper and lower limits of the class in- 


tervals used for constructing the histogram (see 
figure 4). 

13.2 Compute the midpoint of each class interval. 

13.3 Compute the mean of the grouped data using 
equation 3, figure 4. 

13.4 Indicate the mean value on the horizontal axis 


of the histogram {see figure 2). ao 


14. Compute the standard deviation of grouped data. 
14.1 Enter the class intervals and frequencies on a 
te bular worksheet ‘see figure 5). 
Determine the origin—the class interval which 
contains the mean vatue (computed in step 13). 
Determine the difference between each class 
interval andthe origin in multiples of class inter- 
vals, e.g.,t 1,4 2,..., intervals fromthe origin 
(see cure 4°. 
Compute the standard deviation using equation 
4, figure 5. Tre sims are computed by com- 
oleting each row of the table and chen ac ding 
PF 


. 1 
thé appropriate columns. 
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/ Frequency Histogram for a Continuous Variable 

The procedure is essentially the same as for a discrete 
variable except that the variable values may be in frac. 
tional multiples of a basic unit measure. The data are 
grouped into class intervals, and every value falling within 
the upper and lower values of the interval constitute one 
occurrence of that interval. 


EXAMPLE 


The examples in figures 1 and 2, while abstract, i]us- 
trate several interesting points. Figure 2 represents a clus- 
tering of the data points from figure 1 into uniform class 
intervals of two units each. Note the loss of detail in the 
shape of the histogram. The statistics for the measures of 
central tendency (mean, mode) change little. However, 
the clustering of the data values does have an effect on the 
standard deviation. 

The use of histograms (and frequency distributions) is 
illustrated in Subjective Probability Assessment (SPA, 
page 137), Delphi (DLP, page 168), and Surveys (SVY, 
page 36). 


THEORY 


Frequency histograms are based on the concept of ran- 
dom variables and the theory of probability. Probability is 
the frequency of occurrence of a particular event—a dis. 
crete value or a value within an interval. Though this event 
may be random, the result of many repeated measure. 
ments generates the frequency distribution function of 
the random variable. It is convenient to categorize these 
functions into characteristic forms, e.g., the uniform dis- 
tribution characterizes a variable which is equally likely to 
take on any value within its range. The corresponding 
histogram would be nearly flat. 

Frequency histograms represent the distribution of a 
finite sample of measurements. The ability to generalize to 
the basic phenomenon measured is a function of sample 
size. 

Smith (1975) gives an excellent treatment of data anal- 
ysis and statistical computation. For example, Saying that 
all response choices for a questionnaire are equally likely is 
the same as saying that the response histog-am is uniform 
(flat) over the range of response. For a smal] sample, this is 
not likely to be the case. 
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FIGURE + 
Mean of Grouped Data 
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SUM, = 246 


SUM, = 60 


MEAN OF GROUPED DATA = SUM;/SUM, = 246/60 = 4.1 


FIGURE 5 
Standard Deviation of Grouped Data 


d Fre cy X 
Midpoint Difference From Frequency X Difference aie 
of Class Interval Frequency | Mean Class Interval Difference Squared Squared 


SUM = 128 


STANDARD DEVIATION CALCULATION: * 


1) SUM, +SUM, = 128/60 = 2.13 5) Square root (4) = 1.43 
2) SUM2 + SUM, = 18/60 = 0.3 6) Size of Class Interval = 2 
3) Square of (2) = 0.09 7) Multiply (5) x (6) = 2 x 1.43 = 2.86 
4) Difference: (1— - (3) = 2.13-09 = 2.04. STANDARD DEVIATION = 2.86 
SIZE OF 
“STANDARD DEVIATION = CLASS X_  V/[(SUM3/SUM,) — (SUM2/SUM, )?] = 3.05 
INTERVAL 


Subjective Probability 
Assessment 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 


Subjective probability assessment quantifies expert 
judgments about the chance of specific events occurring. 


GCSES 


Subjective probability assessment is used to: 

1) Provide the probability distributions required for 
using certain techniques, such as Decision Trees (DTR, 
pege 141). 

2) Make individzal judzments explicit so that they can 


be compared or ageregated with each other. 


KEY DEFINITIONS - 
1} An event is a furure outcome, the occurrence of 
which is uncertain, e.g., ‘favorable trading conditions 


with Temasek next year.” 

- ; F Pe F mh at ea ke ‘ ; 
2, A subjective probability isa quantified judgment of 
che chance of an event occersing. 


3) A probability distribution associates each event in 
the set with its probability of occurrence. 

4) A set of discrete events consists of a finite number 
of mutually exclusive events. For example, the possible 
outcomes, or events, for casting a die would be numbered 
1, 2,3,...,6;and “monsoon arrives earlier than usual,” 
“‘monsoon arrives as usual,’’ “monsoon arrives later than 
usual.” 

5) An assessor estimates the probability distribution 
of a set of events. 

6) The relative chance reflects whether one event will 
occur rather than another. 

7) The ratio method estimates probabilities fora set of 
events by first obtaining the relative chance of pairs of 


events for all possible pairs. 


SHORT DESCRIPTION 

Assessment of subjective probabilities requires the 
identification of a set of discrete events. An assessor then 
considers these events, two at a time, to determine the 
relative chances of those events occurring. This procedure 
is known as the ratio method, Simple computations then 
determine the probability distribution for the set of dis- 
crete events. Subjective probabilities may also be obtained 
for a set of continuous events by modifying it into a dis- 


ore ce Set, 
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ADVANTAGES 
1) Probability assessment makes the judgments of an 
individual explicit, thus allowing others to understand and 


respond. 
2) The ratio method is easy to use because the proba- 


bilities are assessed indirectly by comparing the chances of 


occurrence for pairs of events. 


LIMITATIONS | 

1) When the assessor is not motivated to perform and 
to think about the analyst’s questions, the probabilities 
obtained may not be valuable. In addition, an assessor 
with no background in probability theory will not per- 
form as well as one familiar with the technique. 

2) When there is a large number of events, the ratio 


method becomes tedious. This method may also lead to 
inconsistencies which may be difficult to resolve. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

After the assessor considers and gives his estimates for 
the relative chances of various events, the analyst performs 
minor computations to arrive ata probability distribution. 


SKILL LEVEL 

The analyst should be able to interact effectively «with 
the assessor through skilled interviewing (IVW, page 23). 
An assessor with a basic understanding of probability will 
be better able to quantify his judgments. 


TIME REQUIRED 


Considering a set of ten events takes about 30 minutes. 
The time required depends on the number of events. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) A set of continuous events consists of an infinite 
number of events. For example, the gross national product 
(GNP) for a coming year may range from one billion to 
five billion dollars and may actually be any value in that 
range. This may be modified by grouping the continuous 
events into discrete events. One event in the GNP example 
would be “less than two billion dollars”; another event 
would be “‘between two billion and three billion dollars,” 
etc. 


§ 


FIGURE 1 
A Probability Density Function 
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2) A probability density function represents the srob- 
ability distribution of a set of continuous events. The 
function may be expressed as a curve (see figure 1}. The 
area under the curve for any interval of values is the prob- 
abiliry that one of the values in that interval will cccur. 
For example, the shaded area in figure 1 represents the 
probability that any value from four to five cccurs. 


REQUIRED INPUTS 

A set of events will generally be defined by the decision 
maker by using a technique like the Delphi (DLP, page 
168). 

The events in a set may be described in quantitative or 
qualitative terms. A quantitative description (e.g., dollar 
value of exports of beef) may be classified in qualitative 
terms (e.g., high, medium, or low dollar exports). A quali- 
tative description always describes a set of discrete events, 
whereas a quantitative description may apply toa set of 
discrete or toa set of continuous events. 

The assessor will generally be someone whose prior ex- 
periences, knowledge, or insights are pertinent to the set 
of events being considered. He may be an external expert 
or the decision maker. 

The subjective probability of a single assessor is fre- 
quently not as accurate as the aggregated estimates from 
several assessors. One way to improve the assessments is to 
have a group discussion on the questions posed by the 
analyst. Another way is touse a Delphi(DLP, page 168) in 
which the assessments of each individual are fed back to 


others in the group. 


TOOL OUTPUT 

For a set of discrete events, the output isa probability 
distribution. For a set of continuous events, the outputis 
in the form of a probability density function (see figure 1). 


For any interval of values, the area beneath the curve rep- 
resents the probability that one of the values in that inter. 
val will occur. For example, the shaded area represents the 
probability that any value from four to five will occur. 


METHOD OF USE 


GENERAL PROCEDURE AND EXAMPLE 


The ratio method is used to elicit probabilities for a set 
of discrete events.* The following steps are involved: 


1. Identify and label set of events. 
Give each event a label, such as x), x. ..., x,. For 
example, take the set of possible events: ‘“‘number of 
tourists coming to Temasek over the next five years: 
Identify and label three events in the set: 
x; = higher number of tourists than last five years 
x2 = same number of tourists as last five years 


x3 = lower number of tourists than last five years 


to 


Assess relative chances. 
2.1 Consider events two at a time. First, ask an asses- 


sor to estimate the relative chance for events x, 
and x2. Then assess events x2 and x3, x3 and X4, 
xq and xs, and so forth until all pairs up to and 
including x,,., and x,, are covered. For the tourist 
example, the analyst may ask: How many times 
is it more likely for the event ‘higher number 
of tourists” to occur rather than the event “same 
number of tourists’? If the assessor answers 
1.5, this is represented mathematically as: 


PRT PPS ore (1] 
or 

Pixs) S23 Fie) {2] 
where 

P{x;) = probability of event x;, i= 1, wo oy 
2.2 Similarly, he may assess: i 

Pixs} Pixs) 21/2 [3] 
or 

Pins) © Fs) [4] 


Continue this process for each pair of events. 


3. Examine probabilines for inconsistencies. 
3.1 Check inconsistencies by asking the assessor to es- 
timate the relative chance of acombination of two 
events which has not been assessed in step 2. For 
che tourist examcle. the assessor may be asked to 
estimate the relative chance of events x) and x3, 


ie. what is his 
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His answer should mathematically reflect his pre- 
vious answers. In checking, it is seen that: 


P(x1) / P(x3) = [P(x1) / P(x2)] X [P(x2)/P(x3)] 
= 3/2 X.1if2 
= 3/4 [5] 
or 


P(x)) = 0.75 X P(x3) 


If his answer differs from 3/4, the inconsistency 
would have to be resolved by having the assessor 
re-estimate the relative chances of events x, and 
x3, 0r of xz andx3. 

3.2 Another method of checking inconsistencies is to 
directly ask the assessor to estimate the probabil- 
ity of an event. This is compared to the computed 
probabilities done in step 4. 


4. Compute the probability distribution. 
Compute the subjective probability of each event 
based on the assessed ratios of the paired events. By 
definition, all the probabilities must sum to unity: 


Pix) + P(x2} + Pix3) = 1.0 [6] 


Equations [2], [4], and [6] can then be solved simul- 
taneously to give: 


P x1)= 1/3 
P(x2) =. 2/9 
P(x3) = 4/9 


Hence, the subjective probabilities of the three events 
are 1/3, 2/9, and 4/9. 


The assessment of a probability distribution for the 
continuous Case is similar to the discrete case. For the con- 
tinuous case, there is a range of values which may Satisfy 
the set of events. This range is divided into intervals, and 
each interval is treated as an event in order to reduce the 


continuous Case to a discrete event problem. 


1. Identify and label set of events. 
1.1 Identify the likely range of values which the set of 


events may take on, e.g., the number of tourists 
visiting Temasek in the next five years may range 
from one to three million (see Rating Scales, RTS, 
page 29). 

1.2 Divide the likely range of values into equal inter- 
vals, the number of intervals generally being be- 
tween six and eight. Values less than the lower 
limit of the range are intervals, as are valucs greater 
than the upper limit. Six intervals for the tourist 


exam ple may be: 
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less than 1 million touris‘s 
1 to 1.5 million tourists 
1.5 to 2 million tourists 
2 to 2.5 million tourists 
2.3 to 3 milion tourists 
more than 3 million tounists 
1.3 Label the intervals “‘x,,x2,..+)*n- 
Assess relative changes (see discrete case, step 2). 
Check inconsistencies (see discrete case, step 3). 
Compute the probability distribution (see discrete 


case, step 4). 


kW 


Keep in mind that the events for the continuous case 
are intervals comprising a large number of values. Plota 
probability distribution in the form of a probability den- 
sity function. For the tourist example, the graph may look 
like figure 2. Each rectangle represents the probability of 
occurrence for the event (or interval), Draw a curve 
through the mid-points of each rectangle’s height for the 
respective intervals. This curve is approximately the 
probability density function for the continuous set of 


events being considered. 


THEORY 


There are several other methods of assessing subjective 
probabilities. Huber (1974) identifies a Variable Interval 
Method fora set of continuous events, as contrasted to the 
use of fixed intervals. Other methods involve the use of 
betting or wagering (Lichtenstein and Slovic, 1972; Wink- 


ler, 1972). 


FIGURE 2 
A Probabiliry Density Function for 


1.0 the Tourist Industry of Temasex 
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Decision Trees 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


The decision tree technique accounts for alternative 
outcomes by representing and analyzing the choices of ac- 
tion andthe expected consequences. 


USES 

The decision tree enables an analyst to: 

1) Represent the decision situation confronting the 
decision maker. 

2; Qualitatively assess a sequence of decisions and the 
chance events which may affect outcomes. 

3} Compute the expected payoff values for a given se- 


guence of decisions. _ 

4: Determine a desired sequence of decisions accord- 
ing to the decision maker’s criterion, e.g., maximizing pay- 
off. 


5; Determine the expected benefit by pursuing further 
information regarding the consequences of decision 


choices. 


KEY DEFINITIONS 


1) The payoff values represent the gain resulting from 
the occurrence of a particular action-event path. 

2) An action-event path is the sequence of alternative 
actions and relevant events represented by the branches of 
a decision tree. Deciding to plant new seed varieties and to 
double crop and then having fertilizer available and an 
early monsoon is one action-event path in figure 1. 

3) Utility is a quantitative expression of the worth or 
satisfaction associated with an outcome. 


SHORT DESCRIPTION 

A decision tree diagrams alternative choices available in 
a decision-making situation, the events which affect each 
alternative, and the payoffs that would result from making 
the various decisions. Sequences of decisions and events 
are diagrammed as successive branches ona tree gtaph (see 
gure 1). The probabilities of each event occurring are es- 
timated and used to compute expected payoffs of various 
alternatives. These are used to select a sequence of deci- 
sions which maximize the probable payoff. 


ADVANTAGES 


The decision tree: 
1) Forces explicit consideration of alternative actions 


and events whichaffect the actions and payoffs. 
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14 
FIGURE 1 
Decision Tree for Farmer with Choice of New Seed Variety and Double Cropping 
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2) Helps the decision maker to quantify the decision 
process. 

3) Provides a comparison between alternatives even 
when absolute measures for evaluating alternatives are dif- 
ficult to obtain. 

4) Easily communicates a complex problem situation 
as a sequence of decisions. 


LIMITATIONS 


1) The probabilities of different future events may be 
difficult to obtain, thereby limiting the reliability of the 
decision. 


Value Associated 
with Outcome 


($ profit/hec tare) 


2) The expected payoff may be difficult to quantify; 
and surrogate measures, such as utility, may have to be 
used (see Multiple Criteria Utility Assessment, MCU, page 
32}, 


REQUIRED RESOURCES 


SKILL LEVEL 


The analysis is straightforward; but estimating proba- 
bilities and evaluating the merits of the different action- 
event paths require judgment. Subjective probability as- 
sessment (SPA, page 137) and multiple criteria utility as 
sessment (MCU, page 32) may be used. 


TIME REQUIRED 


Obtaining the data for the analysis may require the 
most time—from a few hours to several months. For in- 
stance, a survey (SVY, page 36) or opinion poll may be 
needed to estimate the probabilities of the public accept- 
ing an innovative change. 

Analysis requires an hour or less, depending on the 


complexity of the tree. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) Mutually-exclusive events are such that the occur- 
rence of any one precludes the occurrence of the others, 
e.g., rolling a die (six events are possibie). 

2) Collectively-exhaustive events have the property 
that the sum of their individual probability of occurrence 
is 1.0. 

3} A contingency table is a matrix representation of a 
decision involving multiple alternatives (rows) and mutu- 
ally-exclusive, collectively-exhaustive states of nature 
(events) (see figure 2). An outcome corresponds to each 
intersection of an alternative and a chance state of nature 
(see Contingency Analysis. CGA, page 147). 


REQUIRED INPUTS 

The decision tree technique requires a grasp of the deci- 
sion situation with regard to both the range of options and 
the events which affect the outcomes. The probability of 
each chance event must be estimated and the value associ- 
ated with each outcome must be determined if the tree is 
to be used to select the desired decision. This may require 


preliminary data gathering. 


TOOL OLTPUT 

The decision tree provides a representation of the deci- 
sion sirzation which, without further quantification and 
znzlvsis. can be useful to decision maxers. However, fur- 
ther analysis permits the determination of the sequence of 
Cecisions which yields the best possible outcome for a 


even decision criterion, e.g., maximizing payoff. 


IMPORTANT ASSUMPTIONS 
All the decision options can be cerermined a priori, i-e., 
w ootions develop asa consequence of future events. 


& 
events affecting the outcome cf an alternative ac- 
ail 


hos. 
A 
tion are mutually exclusive and ccllectively exhaustive. 


Se weee o- ahha 
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METHOD OF USE 
PROCEDURE 


1. Construct the first decision-event stage. 

1.1 Identify the decision alternatives. 

1.2 Arrange the action alternatives as the branches 
from a decision node (diamond) (see Tree Dia- 
grams, TRD, page 74). 

1.3 Identify the chance events which affect the vari- 
ous outcomes of the decision alternatives. 

1.4 Arrange the events as branches emitting from the 
chance node (circle) at the end of each alternative 
action (see figure 2). 


2. Construct successive decision-event stages as necessary. 

2.1 Identify subsequent decisions which may affect 
the outcome of the initial alternatives. 

2.2 Add these to the appropriate branch as a second 
stage decision (see figure 1). 

2.3 Identify events which affect the various outcomes 
of the second stage decision. 

2.4 Add these events as branches to complete the sec- 
ond stage. 

2.5 Repeat the above process for successive decisions 
and chance events which affect the outcomes. 


3. Determine the event probabilities necessary for analyz- 


ing the decision situation. 

3.1 Estimate the probabilities for the occurrence of 
each event affecting the decision-event Stages (see 
Subjective Probability Assessment, SPA, page 
137). 

5.2 Write the probabilities on the branches corres 
ponding to each alternative event (see figure 2). 

3.3 Verify that the probabilities for all branches emit- 
ting from any chance node sum to 1.0. 


4. Determine the payoff or utility associated with each 
outcome. 

4.1 Estimate the value of each outcome which results 
from the occurrence of an alternative action se- 
quence and chance events. The value may be the 
cost, payoff, or utility of the outcome (see Mult- 
ple Criteria Utility Assessment, MCU, page 32). 

4.2 Write the associated value in a box at the end of 
each tree branch (see figure 2). 


5. Determine the desired sequence of decisions. 


5.1 Determine the criteria for selecting among alterna- 
tives: 
a) Maximizing expected payoff, 
b) Maximizing expected utility, or 
c) Minimizing expected costs. 


FIGURE 2 
The Decision Tree Representation of a Decision Under Risk 
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b) Corresponding Contingency Table for Single State 


Chance Events / States of Nature 


NOTE: Computing position values: 


Node 1 = maximum (minimum) of position values for Nodes 2 and a; 
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FIGURE 3 
Analyzing the Decision Tree to Determine Maximum Expected Profit/Hectare 
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5.2 Beginning at the terminal decision stage (the end 
of the tree), compute the position value of each 
chance node. Sum the products formed by the 
probability of each event and the value associated 
with the outcome of the event. Wnite the com- 
puted total beside each node (see figure 2). 
Working toward the beginning of the tree, deter- 
mine the position value of each decision node. Ap- 
ply the criterion to select among the values at each 
event node branch. For example, if the criterion Is 
to maximize payoff or utility, then select the larg- 
est value; if the criterion is to minimize costs, then 
select the smallest value among the successive posi- 
tion values. Write the selected value adjacent to 
the decision node (see figure 2). 

Repeat the above process for each stage of the de- 
cision tree until the position value of the first deci- 
sion node has been determined. The desired se- 
quence of decision alternatives is the marked 


- branches in the tree. 


EXAMPLE 
A farmer isconfronted with the following decision situ- 


ation™ (see figure 1): - 

He may plant a new seed variety which promises to in- 
crease yields, but only if fertilizer is applied at the right 
time. There is a 50% chance that a fertilizer shortage will 
arise which will nullify the benefit of planting the new va- 
riety. 

The new variety has a 90-day maturation period com- 
pared to the 120 days before the old varieties can be har- 
vested. Thus, if the monsoons are favorable, the farmer 
may double crop to further increase his yields (but not 
necessarily to double that of the single harvest output). 
This is risky because the chance of an early monsoon sea- 
son has been forecast at 80%. The farmer risks losing not 
only the second crop, but overall profits are reduced by 
the additional planting costs. 

This decision situation was diagrammed as a two-stage 
decision tree, and the expected profit was estimated for 
each outcome (see figure 3). It is not necessary to consider 
the double cropping choice decision if the traditional seed 
varieties are planted. Also, the event of an early monsoon 
does not affect the single crop alternative because of the 


shorter growing season. 


*This example was inspired by Ken Smith's report, Fertilizer Dis- 
tribution Project, August-December 1972 (Phillipines Mission: 
United States Agency for International Development, January 
1973). 


Computing the desired sequence of decisions is simply 
a matter of working back through the tree computing the 
position values at each node. The position values of the 
chance nodes (3, 6, and 7) were computed using the ex- 
pected value of the chance events, which is the sum of the 
products formed by multiplying the probability of the 
event and the estimated value associated with that out- 
come. For example, the position value of node 6 is: 

E (v) = (0.8) X (110) + (0.2) X (200) = 128 
This value was written by the node (see figure 2). 

The position value at each decision node (1, +, and 5) 
was determined from the criterion to maumize the profit 
Consequently, the branch was chosen which gave the max- 
imum expected value. The position value of node 4, for 
example, is 130, indicating that planting only a single crop 
maximizes the expected profit However, applying the 
same criterion at node Sindicates that, inthe case ofa fer- 
tilizer shortage, the expected profit is maximized by plant- 
ing the second crop (even though early monsoons are 
likely). These preferred choices were indicated on the tree 
diagram as double lines. 

The analysis indicates that planting the new seed vare 
ety is likely to be the most profitable choice. However, the 
decision to double crop depends on the probability of fa- 


vorable monsoons. 


THEORY 


Decision trees are an outgrowth of statistical decision 
theory and probability theory (Magee, 1964). The tech- 
nique is one method of dealing with decision-under-risk 
The analyst attempts to account for alternative outcomes 
by determining the probabilities of chance events. The ele- 
ments of the decision are the alternative courses of action, 
the possible states of nature, and the probability of each 
state occurring (see figure 2). The correspondence be- 
tween the decision tree representation and the contin- 
gency table format should be apparent (see Contingency 
Analysis, CGA, page 147). DeNeufville and Stafford 
(1971) treat the problems in selecting a criterion and 
valuing the alternative outcomes. 


BIBLIOGRAPHY 


DeNeufville, R., and Stafford, J. Systems Analysis for En 
gineers and Managers. New York: McGraw-Hill, 1971. 


Magee, J.F. ‘Decision Trees for Decision Making.’’ Har- 
vard Business Review (July-August, 1964): 126-38. 


Contingency Analysis 


‘ . 


PREREQUISITE 
Decision Trees, DTR, page 141. 


TOOLS 


USAGE 
PURPOSE 


Contingency analysis helps a decision maker choose 
2mong alternative plans designed for various contingen- 


cies. 


USES 

Contingency analysis is used to: 

1) Inform decision makers about long-range plans. 

2) Select strategies to achieve specified objectives in 
uncertain situations, e.g., a health delivery strategy under 
unknown disease conditions. 

3; Choose actions when major changes in the problem 
environment are expected and where there is uncertainty 


about the nature of the change. ee HO eae 


~e + 


KEY DEFINITION 

A contingency is a particular combination of factors 
that Cescribes a future environment. For example, a con- 
tingency in agricultural planning may describe an environ- 
ment where there is a large deficit in world food produc- 


tion, failure of monsoons for two consecutive years, a 
large under-nourished population, and a poor trade bal- 


ance. 


SHORT DESCRIPTION 


Possible future states associated with a problem situ- 
ation are described by contingencies. Alternative plans are 
developed for each contingency (see figure 1). Each plan is 
evaluated either qualitatively or quantitatively using tech- 
niques such as cost-effective ness analysis (CEA, page 219). 
Plans are compared for a specific contingency as well as 
across contingencies using various criteria to simplify the 
analysis. A contingency table is prepared and recommend. 
ations are formulated for the decision maker. 


ADVANTAGES 

Much of systems analysis assumes a level of determi- 
nacy which ignores the many uncertainties involved. Con- 
tingency analysis specifically encourages planning for al- 
ternative outcomes. Consequently, the plans selected and 
implemented are generally more flexible than those which 
are developed for only one possible future state. 


LIMITATIONS 
There is always the danger of overlooking contingen- 
cies, partly because of the necessity of planning at one 
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FIGURE 1 
Contingency Table with Qualitative Evaluation of Plan 


ALTERNATIVES A 


fair 


NOTE: FI 
“Plan not applicable to this contingency. 
**Plan 3 was designed specifically for Contingency Ej 


point in time. The future situation may be shaped by the 
present planning decisions, * making contingency analysis 


an extremely complex process. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

The effort required to develop a plan tor a single future 
state is multiplied by the number of contingencies iden- 
tified. The task of identifying contingencies and analyzing 
plans adds to the total effort. 


SKILL LEVEL 


The analyst must add foresight and intuition to his 
basic planning skills in order to identify alternative out- 
comes and account for their consequences. A multi- 
disciplinary team brings useful skills to the task and is 


recommended. 


TIME REQUIRED 

The time needed depends on the complexity of the 
planning required. Time is proportional to the number of 
contingencies considered and the novelty of the situation. 


“In this eventuality, the analyst may draw on the theory of com- 
petitive games (see Madansky, 1968). 


ans are evaluated ona scale: very poor-poor-fair-good-excellent relative to the p 


Performance 


articular contingency. 


DESCRIPTION OF TOOL 


SUPPLEMENT AL DEFINITIONS 

1) Best-estimate analysis selects the plan which was de- 
veloped for the most likely contingency. 

2) Worst-case analysis selects the plan which was devel- 
oped for the most adverse contingency. 

3) A fortiori analysis is a process of excluding alterna- 
tives which still perform badly relative to the others, even 
when designed for the most favorable contingency. 

4) Sensitivity analysis is a process of varying the estt 
mated values of selected parameters in the design to deter- 
mine the sensitivity of the results to the uncertainty of the 
estimates. 


REQUIRED INPUTS 


Contingency analysis requires a grasp of the many fac- 
tors which contribute to uncertainty in planning. The 
plans must be developed using a variety of techniques and 
expertise. The more points of view brought to bear on the 
planning process, the more likely that contingencies will 
not be overlooked. A multi-disciplinary team approach is 
preferred. 


TOOL OUTPUT 


Contingency analysis presents the decision maker with 
an array of options which reflects the analyst's under- 
standing of future uncertainties. A plan may be recom- 


mended as a result of the analysis. The very least the 
decision maker can expect is an analysis of the array of 
contingent factors and planning assumptions (DeGreene, 


1973), 


IMPORTANT ASSUMPTIONS 


All relevant contingencies have been identified and 
only these contingencies are likely to occur. 

Measures of plan or system effectiveness which are ap- 
propriate for one contingency can alsobe applied to other 
contingencies. 


METHOD OF USE 
GENERAL PROCEDURE 


1. Analyze the problems in order to determine the fac- 
tors (social, technological, political, or environmental) as- 
sociated with an uncertain future. 

2. Identify likely combinations of factors: these con- 
tingencies describe possible futures (see Scenarios, SCN, 
page 164). 

3. Specify alternative plans for dealing with each con- 
tingency (see IDEALS Strategy, IDL, page231),and Pro 
gram Planning Method, PPM, page 227), 

4. Identify criteria for evaluating the expected effec- 
tiveness, benefits, or utility for each plan (see Cost-Effec- 
tiveness Analysis, CEA, page 219; Cost-Benefit Analysis, 
CBA. page 212; or Multiple Criteria Utiliry Assessment, 
MCU, page 32). 

5. Consdering only one contingency at a time, evalu- 
ate each alternative relative to the other alternatives and 
tzbulate results (see figure 1) to provide a comprehensive 
picture of the decision parameters. 

6. Apply one of the following criteria to reduce the 


number of contingencies: 

a) Best-estimate analysis: Assume that all uncertain 
factors are determined by the analyst’s best estimates. 
Design alternative plans accordingly. 

b) Worst-case analysis: Assume that the most ad- 


verse contingency will occur. Design a plan (or select 


the alternative) for thiscontingency on the assumption 
that if it works for the worst case, it will work for the 
more favorable concngencies. 

c} A fortiori analysis: Assume that all uncertainties 
zre resolved as optimistically as possible. Design (or 
select’ a plan for this case and compare its performance 

:o the others. If it still performs badly, discard that al- 

teraeive, 

7. Use sensitivity analysis to examine assumptions 
ardor eliminate variables which have little influence on 
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the expected performance of alternatives (see Cost-Effec- 
tiveness Analysis, CEA, page 219). 
8. Asa lastresort, consider plans which either: 

a) Buy time until the social, political, or techn olog- 
ical situation changes; 

b) Buy information in order to resolve some of the 
uncertainties affecting the decision, e.g., gather more 
data;or 

c) Buy flexibility in design, ie., plan systems with 
the capability to adapt to various contingencies. 

There are additional costs associated with each of 
these options, but they may be the best way of dealing 
with the uncertainties of planning for various contin- 


gencies. 


EXAMPLE 

The Temasek Government wanted to develop a strat- 
egy for increasing agricultural productivity in a region 
populated by small-holders. A list of unknown factors was 
generated: the degree of cooperation among farmers, the 
migration rates from (or to) the region, the availability of 
necessary climatic and technological variables (e.g., the re- 
sponse of new seed varieties to unfavorable monsoon con- 
ditions). 

Two contingencies were formulated and preliminary 
plans were sketched for each. 


Contingency A 

The people in the region are expected to cooperate 
with government efforts. There is low migration of popu- 
lation to urban areas. Favorable monsoons are predicted. 
Fertilizers are available. 

Plan 1: Educate the people about the need for in- 
creased productivity, new seed varieties, and new agricul- 
tural techniques. Distribute fertilizer and encourage its 
use. Subsidize commercial credit. 

Plan 2: Form farm cooperatives with government par- 
ticipation. Acquire farm machinery with the financial 
strength developed, using modern techniques on consoli- 


dated holdings. 


Contingency B 
The people in the region may be hostile to intervention 
and are not receptive to improved farming methods. 
There is migration of population to urban areas. Monsoons 
are expected to be erratic and poor. A fertilizer shortage is 


expected. 
Plan 3: Nationalize productive holdings. Import labor 
if needed. Farm large tracts of land using mechanical farm- 


ing and irrigation methods, 


150 / ACCOUNTING FOR ALTERNATIVE OUTCOMES 


FIGURE 2 
Contingency Table for Agricultural Strategy Planning 


Plan 1: Education Strategy — 


Plan 2: Cooperatives Strategy 


NOTE: Effectiveness measure: Percentage increase in agriculeura! production for there 


Contingency B 


Contingency A 
(Pessimistic) 


(Opcimistic) 


*Estimated decrease of 5% if Plan A is selected and Contingency B occurs. 


Plan 4: Encourage private farming. Develop irrigation 
facilities and help finance. Provide incentives for farmers 


to immigrate from other regions if necessary. 


A contingency table was prepared to represent the deci- 
sion elements (see figure 2). The analysts then estimated 
the effectiveness of each plan using the criterion: expected 
percentage increase in agricultural production given a par- 
ticular contingency. Analysis across contingencies fo!- 


lowed: 


Best-estimate analysis: Only plans 1 and 2 need be 
considered because contingency A is assumed to be the 
future environment. From these two, plan 2 was pre- 


ferred. 


Worst-case analysis: Only plans 3 and 4 were con- 
sidered. Plan 4 was chosen due to the higher expected in- 


crease in production. 


A fortiori analysis: Plan 1, designed for the most op ti- 
mistic set of factors, was still less effective than plan 2. 
Therefore, plan 1 was “dominated” by plan 2 and was not 
considered further (although parts of the plan were con- 
sidered in synthesizing a flexible, adaptive strategy). 


Sensitivity analysis: Agricultural productivity esti- 
mates were found to be highly sensitive to weather condi- 
tions. Consequently, the planners decided to delay adopt- 
ing a particular strategy until pilot field trials were con- 
ducted in the region. Meanwhile, a sam ple survey was com- 
missioned to examine farmer attitudes on cooperation and 


modernization. 


THEORY 


Contingency analysis falls under a category of statis 
tical decision theory identified as decision-under- 
uncertainty (Peston and Coddington, 1968). This situa- 
tion is contrasted with models for decision-under-risk 
exemplified by decision tree analysis (DTR, page 141).A 
decision-under-uncertainty is transformed to a decision- 
under-risk if probabilities of each of the states of nature 
(contingencies) can be estimated (see Subjective Proba- 
bility Assessment, SPA, page 137). 

Schlesinger (1968, page 385) describes contingency 
planning from two different points of view. One group of 
planners “‘believe that the array and character of future 
contingencies can be specified in advance, and that de- 
tailed advance planning can be done to deal with which- 
ever one does occur [original italics} .” A second group be- 
lieves ‘“‘that contingencies cannot be specified precisely in 
advance,” and that plans must be designed with the capa- 
bility of adapting to unforeseen contingencies. Although 
the description of contingency analysis was written from 
the viewpoint of the first group, the complexities of devel- 
Opment project planning strongly support the more cau- 
tious approach of the second group. 
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Forecast and Prediction 


Exponential Smoothing Forecasts 
Regression Forecasting 
Scenarios 


Delphi 


The selected forecasting techniques fit into two categories. Extrapolati+: techniques (Ex- 
ponential Smoothing Forecasts and Regression F orecasting) base forecz:+: of future behav- 
ior on past performance data and assumptions about the underlying prezesses which have 
generated the data. Intuitive techniques (Scenarios and Delphi) systemz=zzlly combine the 
observations not only of past and present conditions, but predictions of £:<:re performance, 


constraints, and forces for change. 


Exponential Smoothing 
Forecasts 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


Exponential smoothing provides short-term forecasts 
of variables by extrapolating from past data. 


USES 

Exponential smoothing is used to: 

1) Forecast demand for services or goods. Pine. 

2) Obtain economic forecasts. 

3) Forecast any variable where past behavior is ex- 
pected tocontinue. 

4) Provide forecasts at regular intervals. 

5) Trace an underlying trend or pattern for a variable 
when random fluctuations in the data obscure that trend. 


KEY DEFINITIONS 
1) The smoothed value is an estimate of the average 
value of the variable being forecast. It is calculated each 
period by the equation: 
S_ = Sy. + (x_ — Sp.1) 


where 
S; = the new smoothed value 
S;.) = the old smoothed value 
@ = asmoothing constant 
x, = new datum 


2) The period of a time series is the time interval be- 
tween successive observations of the underlying process. 
This interval may be a day, a week, a month, or one or 
more years. For example, the period would be a week if 
the datum is the weekly total of immunizations per- 


formed. 


SHORT DESCRIPTION 


A smoothed value of the average of the dza is the basis 
for forecasting by exponential smoothing. This value is 
calculated for each period using the data for that period 
and the smoothed value from the previows period. The 
new smoothed value becomes the forecast for the next 
period if the average value for the variable is expected to 
remain constant (see figure 1a). However, variables with a 
steadily increasing or decreasing average (a trend) can also 
be forecast by obtaining a smoothed value for the average 
and a smoothed estimate for the trend component. The 
forecast for the next period is the sum of the two estimates 


(see figure 1b). 


FIGURE 1 
Plots of Past Data 


a) Plot fora Variable with Constant Average 
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ADVANTAGES 


1) Exponential smoothing is easy to understand and 
use since it relies on intuition and simple mathematics. 

2) When changes occur in the behavior of the variable 
being forecast, exponential smoothing can continue to be 
used since gross errors in forecasting smooth out after a 
few periods. 

3) Large quantities of past data need not be retained 
(see Regression Forecasting, RGF, page 160). 


LIMITATIONS 


1) Exponential smoothing is not a causal model: it 
only extrapolates from past data. Since past behavior only 


partly explains the future, exponendal smoothing may. 


not always be sufficient. 
2) A more complex smoothing model is necessary to 
accurately forecast cyclic variations in data (see Mont- 


gomery. 1968). 


REQUIRED RESOURCES 


LEVELOFEFFORT 


Exponential smoothing involves the substitution of 
numerical values into simple formulae. The effort required 


is minimal. 


SKILL LEVEL 

Basic arithmetic skills are needed to use exponential 
smoothing. Some experience in chocsing the smoothing 
constant is necessary to obtain good forecasts. 


TIME REQUIRED 

Once the smoothing constant has been selected, the 
forecast calculations are straightforward and require little 
time. It may be desirable to keep track of the errors in each 
forecas: and take corrective action should they become 


too large ‘see Brown, 1965). This requires a minimum of 


extra time. 


SPECIAL REQUIREMENTS 
A slide rule or a calculator may be used to do the cal- 
culaticns. A digital computer may be desirable to forecast 


a larce numberofvariables. 
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DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 

1) The smoothing constant is a fraction between 0 and 
1 that indicates the degree of confidence placed on the 
most recent datum. It is denoted by “a” in [1]. 


2) x, and x;.1 are data values observed at time ¢ 
and t-1 respectively. 


3) Sj is the smoothed estimate of the average value of 
the variable for the time period t. 


4) Ay, is an estimate for the linear trend for period ¢. 


5) Tis the forecast lead time, or the number of periods 
into the future for which the forecast is being made. 


6) a and B denote the smoothing constants whose 


values lie between O and 1. 


7) x;.1 and x;47 are forecasted estimates of the 
variable x calculated at time ¢ for the next period and 


for T periods ahead, respectively. 


REQUIRED INPUTS 

Some understanding of the variable being forecast 
helps in estimating any trend that may be observable in 
past data. The data may be plotted ona graph against time 
(see figure 1). The variation of the data is shown in these 
plots. Visual inspection indicates the presence of an in- 
creasing trend in the plot shown in figure 1b. 

Selecting a smoothing constant is also necessary before 
forecasting can be done. The function of the smoothing 
constant is to control the amount of importance given to 
the past data. The constant is greater than 0 and isusually 
less than 0.3. The smaller the smoothing constant, the 
greater is the importance given to past data, signaling con- 
fidence that the past behavior of the variable will con- 
tinue. On the other hand, a large smoothing constant (but 
always less than 1) gives more importance to the current 
datum. However, a large smoothi..g constant may lead to 
large errors in the forecasts. A value of 0.2 is recom- 
mended for most applications. 

Initial values for the smoothed estimates are needed be- 
fore forecasting. The starting smoothed value can be taken 
from the plot of the past data. When the graph indicates 
that the data have no trend, only the smoothed value for 
the average needs to be estimated. This can be taken as the 
height of the horizontal line drawn through the data (see 
figure la). If the variable appears to follow a trend, start- 
ing values for both an average value and a trend com- 


ponent are required. 
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TOOL OUTPUT 


The output is a short-term forecast of the future values . 


of the variable. The forecast is computed from the esti- 
mate of the average value or from the estimates of the aver- 
age value and the trend compenent, whichever is appro- 


priate. 


IMPORTANT ASSUMPTIONS 

The model presented here is based on the assumption 
that the process which produced the behavior of the fore- 
casted variable does not change with time. Thatis, the van- 
able is assumed to have either a constant average or acon- 
stant linear trend. Higher order exponential smoothing 
models may be used if these assumptions are not valid fora 


variable (see Brown. 1965). 


METHOD OF USE 
GENERAL PROCEDURE 


Forecasting by exponential smoothing is done in two 
steps: 

1) Updating the smoothed values. 

2) Obtaining a forecast from the smoothed values. 


In the case of a variable with constant average, step 1 
will be used to update the smoothed value for the average. 
In case of a variable with a trend, step 1 will be used to 
estimate the trend and the average value by smoothing. 


Variable with Constant Average 
1. Update smoothed values. 

The smoothed value for the average is obtained by the 
following equation: 

Se =Se.1 + (x~ — S;.1) [1] 
The difference between the new datum and the old 
smoothed value gives an idea of the error in the fore- 
cast. A fraction, a, of this error is added to the old 
smoothed value to obtain a new smoothed value. 


Ww 


. Obtain the forecast. 
The forecast is given by the following equation: 

[2] 
This equation is used since the variable is assumed to 
have a constant average estimated by the smoothed 
value and no trends. When datum for the next period, 
¥¢+ 1, is obtained, the new smoothed value becomes the 
old smoothed value for the next period, and forecast- 
ing is continued by computing the smoothed value for 
that period. These calculations are repeated. 


Xt+1 = Sz 


Variable with Trend 
1. Update smoothed values. 
Obtain a smoothed value for the average and in 2s- 
mate for the trend. The equations used for the two are 
similar. Equation [1] is used to estimate the average. 
The equation used for estimating the trend is: 
Ay = Ag. +8 [(S; —Sp-1) —Ac-2] [3] 


2. Obtain the forecast. 
Add the trend estimate to the smoothed value chaz has 


been newly calculated. The forecast is ziven by the fel- 
lowing equation: 
Xpoy =S,+ Ay i+! 
If forecasting is to be done for more than one time ze- 
riod ahead, the increase (or decrease) due to the tend 
component needs to be accounted for. The forecast sor 
T time periods in the future is given by: 


F - ¢ Tesla ‘ . 
mL a ep =< ; 


Sa his 3 4 
Note that in case of a variable with no trend comzo- 
nent, the forecast for one period ahead and the fcre- 
cast for many ceriods ahead is the same. 

As before, when a new datum is available, the new 
smoothed value and the trendestimate become the old 
smoothed value and the old trend estimate for the next 
period. The calculations are repeated in order to u 


date smoothed values. 


Worksheet 
A worksheet can be used to facilitate the calculation of 
forecasts on a regular basis (see figure 2). The columns .n 
figure 2 represent different stages in the calculation, 
with the forecast given in the final column and the 
datum given in the first column. Each row corresponds 


to a time period. 


EXAMPLE 

It is necessary to forecast the number of births in a dis- 
trict each month in order to procure child immunization 
medicine. Exponential smoothing is used to forecast the 
number of births. A slight increasing trend is assumed to 
be present in the data (see figure 2 for the calculations). 

The worksheet shows that the forecast for births in 
February is 207. The S;.) and A;.) values for March can be 
Written in the row corresponding to March. 


THEORY 


The basic smoothing equation in exponential smooth- 
ing is{1], which can be rewritten as: 
Sp =@(x;) + (1 —a) S,.1 


[6] 
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FIGURE 2 
Work Sheet for Exponential Smoothing 


2 3 4 5 
Difference 
(x4-S¢.} ) 


New 
Smoothed Smoothed 
Value Value 
St. 5; 

(1) - (2) (2) + (4) 


Fraction 


Added 


January 
February 


March 


The smoothed value for the previous time period* was 


given by: 
S11 = alx,.1) + (1— a) S;.2 [7] 


and the smoothed value for the period before is 

St-2 + @(x;.2) + @(1 — @)S;.3 [8] 
and so on. By repeated substitution for S,.1 into [6] and 
then for S;.2 into [7], we obtain: 


S; = a(x;)+a(1 —G)x,.3+...¢a(1 — zx ai?) 


From this equation it can be seen that past data (x>.1, X12; 
x;.3, etc.) have decreasing exponential weights. Hence the 
name exponential smoothing. The weights of the past data 
decrease with the age of the data because a is less than 1. 
Tris makes intuitive sense as more recent data are given 
more weight. The actual weights depend on the smooth- 
ing constant. The earlier discussion on the value of the 


smoothing constant follows directly from [8]. 


"t= present time, therefore f-1 is one time period prior, t-2 is two 


Sime periods priog, #6. 


6 7 8 9 10 12 


Difference] Fraction New Forecast 


I( )-Ay.1] 


Change in 
Smoothed Added Trend 
Value B-[ ) Estimate 
(Sr-Sp-1) Ay 
(5)- (2) | (7)-(6) (6) + (8) 


1+) 


Trend 
Estimate 


At.) 
(5) + (10) 


Similar formulations of exponential smoothing have 
been developed to forecast data that have a cyclic vari- 
ation or a combination of a trend and cyclic variation. 
Montgomery (1968) and Brown (1965) discuss these 


cases at length. 
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Regression Forecasting 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
Regression forecasting obtains the relationships be- 


tween two (or more) variables based on pairs (or sets) of 


past data values. 


USES 
Regression forecasting is used to: 
1) Obtain economic forecasts. 
2) Forecast demand for services and products. 
3) Forecast any variable where past behavior is as- 


sumed to continue. 


KEY DEFINITIONS 
1) An independent variable is the non-random variable 
which is used for forecasting other variables using the re- 


sion. M is the independent variable in: 


gres 
B =a+(6bX% M) 


[1] 
where 

B = number of births 

M = number of marriages registered 


a,b= constants 


2) A dependent variable in regression forecasting is the 
variable being forecast. It is written in the regression equa- 
tion as being dependent on the independent variable. For 
example, in (1] the dependent variable is ‘‘number of 
births.” 

3) A variable is regressed on another when the former 
is dependent on the latter. In [1], the “number of births” 
is regressed on the “‘number of marriages registere a.” 

4) Correlative behavior is an assumed relationship be- 
tween two or more variables in which the changes in one 
variable may be associated with predictable changes in the 
others. The change, however, is not necessarily cause- 


effect. 


SHORT DESCRIPTION 


Regression relates a dependent variable with an inde- 
pendent variable in the form of a mathematical equation. 
The independent variable is usually time, and regression 
extrapolates the past into the future. The equation is ob- 
tained from past data gathered in pairs (a value of the de- 
pendent variable corresponding to a value of the inde- 
pendent variable). 

If the relationship is assumed to be linear, the regres 
sion of the dependent variable on the independent variable 
is a straight line when plotted ona graph (see figure 1). The 
simple linear regression equation is used to obtain fore 
casts of the dependent variable for a given value of the in- 
dependent variable. A dependent variable may be re- 
gressed on two or more independent variables, but this is 


FIGURE 1 
Graph of Regression Line 
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Independent Variable,x _, 
{usually time) 


not easily visualized ona graph. The forecasting method is 


similar, however, to simple linear regression. 


ADVANTAGES 


i) Rezression is a simple and straightforward srocess. 


u 
- 


7’ Regression can be used in a wide variety of situ- 
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ations and is often the only recourse for forecasting. For 
example, in many social and economic contexts, causal or 
predictive models based on theoretical grounds are diff. 
cult to construct. Regression gives an empirical model 
which can be used for forecasting. 


LIMITATIONS 

1) Regression models estimate the correlation be- 
tween variables. This correlative behavior is often mis 
taken as meaning “‘a change in the independent variable 
causes a change in the dependent variable.” This may lead 
to false assumptions about causal relationships (see Oval 
Diagramming, OVD, page 81). 

2) Regression forecasting extrapolates the data in or- 
der to obtain the forecasts. The relationship obtained 
from the data does not necessarily hold outside the range 
of available data, and erroneous forecasts are obtained. 
For example, the relationship between two variables may 
be linear only in the region examined and non-linear in 


other regions. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

The effort required is minimal if the data for the regres- 
sion model are available. However, a considerable amount 
of effort may be required if data collection is necessary. 
For example, surveys (SVY, page 36) may be needed to 
obtain the data. 


SKILL LEVEL 


Some statistical knowledge is needed to fully under- 


stand and use regression. 


TIME REQUIRED 

The time required to gather the data depends on the 
uature of the variable and the amount of data needed. Ad- 
equate regression models can be obtained using 20 to 50 
pairs of data points. Once the data are obtained, the calcu- 
lations require only a few hours. Regression on more than 
one variable takes more time depending on the number of 


variables being considered. 


SPECIAL REQUIREMENTS 


A calculator or a slide rule is useful in making the cal- 


culations. 
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DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) The regression coefficient is the coefficient of the 


independent variable in a regression equation. In [1], 
“bis the regression coefficient. 
2) Symbols: 
x is the independent variable 
y is the de pendent variable 
a and b are regression coefficients. 


REQUIRED INPUTS 

Knowledge about the variables defined in the regres- 
sion equation is needed. Between 20 and 50 sets of data 
points are needed to obtain the regression equation. The 


higher the number of datasets, the higher the reliability of 


the regression e quation. 


TOOL OUTPUT 

The output is the regression equation model relating 
the variables. The model may then be used to forecast 
values of the dependent variable for given values of the in- 
dependent variable. 


IMPORTANT ASSUMPTIONS 


Regression models assume that the independent vari- 
able is deterministic (non-random) and can be measured 
with an accuracy that is much higher than that involved in 
measuring the dependent variable. Often both the vari- 
ables are random, and the variable which can be measured 
with less error is chosen as the independent variable. How- 
ever, most often observations of one variable are made at 
intervals of time. Time becomes the independent variable 
in the regression equation, and the assumption about the 
independent variable is then valid. 


METHOD OF USE 


GENERAL PROCEDURE 


Linear regression fits alinear equation between the var- 
iables (see figure 1). The regression coefficients of the 
equation are selected so that the data values have mini- 
mum deviation from the line. 

The following procedure is recommended to develop a 


regression equation. 


1. Obrcain the data. 
Once the independent and dependent variables are de- 
termined, the data values are obtained in pairs, l.e., a 


for the dependent variable corresponds 19 


datum point 
data 


each value for the independent variable. The 
should be recent and should be representative of che 
trend. Consider a situation where the total industrial 
output in a region for the next year is to be ferecas= 
The industrial output is mown to be correlated to 12 
steel production. The industrial output will be 


annual 
cr past five 


regressed on the steel production. Data f 
years are used to obtain the equation (see gure 2). 


2. Determine the equation coefficients. 
If the relationship between the variables is assumed to 
be linear (see figure 1), the regression equation used ‘s: 
ri y=at bx. (3) 
The regression coefficients are calculated using: 


lai 


n ‘ Bs 
b=S(x—x)iy-y) Dice a [3] 


where 


x,y = averages of n data points for x and y 


1 
¥ = summation of al! terms in parentheses 


computed from data points 


The calculations for [3] are easily done using a table 
(see figure 2b). The data points for x and y are first 
filled in and the averages x’ and y’ calculated. Using 
these averages, the rest of the table is filled in. The 
totals for columns (x-x’) and (y-y’) should be zero. This 
can be used asacheck for calculations. The ratio of the 
totals in columns 5 and 6 then gives the value of b: 


b = 26.86/11.70 = 2.29. 


The coefficient a is calculated by 
a yf = Bee [4] 
In the example, 
a= 16.2 ~(2.29X 5.5) = 3.6, 
the regression equation is 
y = 3.6 +2.29X x. [5] 
3. Forecast using the equation. 
The forecast of anew value of the dependent variable is 
made by fitting the corresponding new value for the in- 
dependent variable into the equation. For example, 
steel production is known to be six million tons. The 
industrial output is estimated by substituting in [5], so 


that: 
(y) = 3.6 + 2.29% 6= 17.34 [6] 


The industrial output (y) is estimated at $17.34 million 
using the linear regression equation. 


EXAMPLE 


Many examples of regression analysis may be found in 
the lirerature. Fredericks’ (1976) analysis of cooperative 
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FIGURE 2 
Regression Computation 


a) Data for Forecasting Industrial Output 


TOTALS 


AVERAGES 


movements in West Malaysia is illustrative and instructive. 
Twelve structural variables were included in the analysis of 


strictural development. 


THEORY ae 


Regression equation models are widely treated in statis 
tics texts (Fryer 1966, or Wetherill 1972). The theory is 
based on summing the squares of the deviation of each 
i2ta point from the corresponding value of the model, and 
then selecting coefficients of the model which minimize 
this sim. If the model equationisa straight line, the coeffi- 
cients fit a linear regression model Non-linear repression 
models are used to fit equation coefficients to data which 
dco not appear to fall ona straight line. 
Multiple regression models use the same basic principle 
fit the observed data to two or more independent vani- 
les. The forecaster is referred to specialized texts 


Draper, 1966) for details. 


to 
ab 


Bedworth (1973) has an excellent Presentztion of re- 
gression forecasting when the independent variable jc 


time. 
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Scenarios 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
A scenario forecasts the future state(s) of a system 
based upon assumptions about interactions and external 


conditions. 


USES 

Scenarios may be employed to: 

1) Identify and clarify major issues for debate among 
policy makers and interest groups. 

2) Formulate a narrative for dynamic behavior of a 
social system, e.g., for interpreting Oval Diagramming 
(OVD, page 81). 

3) Provide the input for techniques such as Gaming 
(GAM, page 124). 

4) Provide a framework for normative forecasts of 
desired future conditions. 


KEY DEFINITIONS 


1) A system is acollection of components which inter- 
act to achieve acommon function. 


2) A state scenario describes conditions and events 
(the state of the system and the external context) ata 
single future point in time. 

3) A transient scenario forecasts the changes in and the 
alternative actions on a system at various stages in the evo- 
lution of the system. 


SHORT DESCRIPTION 


A scenario is a narrative forecast of the future states of 
a system. It is developed from a description of the present 
conditions and an extrapolated forecast of future condi- 
tions. The forecast is based on the external constraints to 
change, and the likely interactions between system vari- 
ables in the progression from current conditions to some 
future state. 

A scenario may be either a state scenario for a single 
point in the future or a transient scenario tracing the evo- 
lution of the system over time. 


ADVANTAGES 


1) Scenarios help illuminate the interaction of psycho 
logical, social, economic, cultural, political, and military 
dimensions in a form that permits understanding many 
such interactions at once. They are especially useful for 
policy decisions. 

2) Kahn and Wiener (1967) argue that scenarios call at- 
tention to the larger range of possibilities that must be 


considered in the analysis of the future. 


3) Scenarios help stimulate and discipline the imagina- 


tion, 
4) Scenarios generally have an illustrative and peda- 
8ogical value for the decision maker. 


LIMITATIONS 

1) It is a formidable task to take into account and suc- 
cessfully predict the interplay of the various dimensions 
(¢.g., Social, political). 

2) Scenarios suffer from uniqueness: they represent 
only the views of those experts who constructed them, 
and there is no guarantee that the future is accurately pre- 


dicted. 


REQUIRED RESOURCES 
LEVEL OF EFFORT 


The decision maker and the analyst collaboratively de- 
fine the subject of the scenario. The analyst identifies, or- 
ganizes, and interacts with a group of experts to under- 


stand the present system and to construct the scenarios. 


SKILL LEVEL 


The analyst and experts should be able to iden tify the 
major dimensions and attributes of the present system in 
order to identify new developments and understand their 


characterand Significance. 


TIME REQUIRED 
The time required depends on the complexity of the 
system being studied and the time span of the scenario. 
The analyst and the experts may spend several days con- 
structing from three to five different scenarios which de- 


scnbe the same general situation. 


DESCRIPTION OF TOOL 
SUPPLEMENTAL DEFINITIONS 


1) The dimensions of a system are collections of its at- 
tributes, where each collection represents a major aspect 
of the system, e.g., political, economic, social, or psycho- 
logical. 

a The attributes of a system include the elements or 
components of the system and the interrelationships 
among them. 

3) A goal is a value judgment which satisfies one or 
more human needs, ¢.g., ‘to promote equality in school- 


Ing.” 
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4) A driving force is an attribute of a system which 
causes changes in the System state over time. 

5) The base system state is the set of current condi- 
tions which describe the essential characteristics of the 
scenario. It is denoted by S(t), where tis the present time. 

6) An intermediate image, S(t + n), describes the 
state of the system after a time interval n. 

7) The external context represents the constraints on 


the base system. 


REQUIRED INPUTS 


Scenario construction requires prior agreement on the 
kind of scenario (either trend or state), the subject of the 
scenario, and the time span to be included. 

The subject of the scenario is generally a system or 
sector of a country or region, e.g., the tourist industry or 
the energy situation for the country of Temasek or the 
social structure of a river basin population. 

The time span varies according to the importance of the 
system under consideration. The time span of the scena- 
no, for most situations, should cover at least 15 years to 
project beyond characteristics of the present situation. 
Future images become increasingly blurred as the time 
span is extended, effectively limiting a scenario to 30 
years. 

The analyst may wish to assemble a group of experts, 
each familiar with a major dimension of the system, 
though the scenario may be developed using a Delphi 


(DLP, page 168). 


TOOL OUTPUT 

The scenario technique generates a narrative descrip- 
tion of the future state(s) of the system. The format is the 
base system state description and one or more inter- 
mediate images, together with a description of the ex- 
ternal context and the driving forces behind the forecasted 


changes (see figure 1). 
One or more scenarios may be constructed: 
1) Several alternative state scenarios for a single point 


in time, or 
2) One (or perhaps two) transient scenarios which 
forecast the effects of different policies on the evolution 


of system conditions. 


These scenarios may be compared and contrasted for 
review by decision makers and interested parties, 


IMPORTANT ASSUMPTIONS 


A scenario is constructed by extrapolating future con- 
Citions from present conditions and foreseeable driving 
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FIGURE 1 
A Standard Format for a Scenario 


S (t + 2n), Intermediate image at time t+ 2n 


Progression over time interval n 


S (t + 3n), Intermediate image ai time t + 3n 


forces for change. Consequently, a fundamental assump- 
tion concerning dynamic system behavior is implied: a 
system exhibits current conditions which are the result of 
all the previous current and prior forces on the system, 
However, social systems are self-organizing and anticipa- 
tory, and the current system state may be influenced by 
anticipated future conditions. Accounting for these 
factors in scenario construction requires that the analyst 
te aware of the possible effect of anticipated actions on 
the future state of the system. 


METHOD OF USE 


GENERAL PROCEDURE 


The following steps describe the development of a 
cransient scenario and are based on the work of Durand 


(1972) and Gerardin (1973): 


1. Construct the base system state. 
1.1 Identify the major subgroups in the base system. 
1.2 Identify the attributes of the subgroups. ; 
1.3 Choose one of the attributes as the driving force 


for change in the system. 


2. Identify the external context. 
2.1 Formulate hypotheses about the constraints on 


change in the base system state. 
2.2 Consider constraints which may change during t 


time span of the system. 


’ 
2 
te 


3. Develop the progression to the first intermediate 


. . ° . 1 F 
3.1 Identify any trends in the interaction berween at- 
tributes of the base system for time interval n, 
where nis typically 5-10 years. 
Identify any changes in the external constraints 
for time interval n. ie 


If alternative or competing trends are likely, con- 


struct an intermediate image at time ¢ + n for 


Jed 


each major trend. 


4. Construct the intermediate image. 

4.1 Using the dimensions and attributes identified in 
step 1, describe the likely system state or condi- 
tionsattimet + n, 

4.2 Take into account the forces for change, the ex- 
ternal constraints, and the trends internal to the 


system. 


5. Repeat steps 3 and 4 until the desired time span has 
been covered. 

5.1 The last intermediate image becomes the new base 
system state. 

5.2 To progress to the next intermediate image, con- 
sider changes for the interval from time t + nto 
timet + 2n,etc. 

5.3 End the scenario with the last intermediate image. 


If a normative scenario is being developed, the pro- 
cedure in step 4 is inverted. Instead of predicting the inter- 
mediate image, the analyst tries to iden tify the alternative 
actions or policies that are necessary to achieve a desired 
system state. This is typically an iterative process, where 
first one set of policies, the internal trends of the system 
and the external context, are used to forecasta likely pro- 
gression. The discrepancy with the normative system state 
is then used to indicate alternative policies until the de- 
sired and the predicted intermediate image merge. 


EXAMPLE 


A scenario was developed for the cattle industry in the 
country of Temasek. The goal was “‘to im prove the quality 
of life for all Temasekians.”” Two criteria indicate achieve- 
ment of this goal: a decrease of nutritional deficiencies 
among the population, and an increase in foreign ex- 


change. 
The base system state was described: 


Four subgroups have been identified: the herdsman, the mid- 
dlemen, the meat-packing industry and the consumers of beef. The 
herdsmen are generally nomadic and own 90 percent of the cattle 
in Temasek. Cattle breeding and feeding practices are inefficient. 
The nomads have a strong emotional attachment to their cattle as 
they equate the ownership of cattle with prestige. 

The herdsmen sell their cattle to middlemen. The cattle reaches 
consumers after going through several levels of middlemen, thus 
inflating the price of beef. 

The meat-packing industry is small at present but is owned bya 
big multi-national company. The beef is packed mainly for ex- 


POLE cas 


The attributes of the subgroups were the value system 
of each subgroup, the economic lin kages between the sub- 
groups, dnd major institutions. The meat-packing industry 
was selected as the driving force for the scenario because it 


wanted to increase its growth rate. 
The external context may be described as: 


There will be maintenance of favorable trading conditions with 
the developed countries. No adverse weather conditions will oc- 


CUrs ce © 


Starting with the base and external context, the progres- 
sion was formulated to give the following scenano: 


It is the year 1977. The demand for beef in developed countries 
is seen to increase greatly over the next seven years. To meet this 
demend a multi-national company invests 20 million dollars in a 
meat-packing plant geared for both domestic and overseas con- 
sumption of beef. 

Educational efforts are carried out to make the herdsmen settle 
and learn better cattle breeding and feeding practices. This will en- 
sure a regular supply of beef for the meat-packing plant. There is 
considerable rescntment by the herdsmen. Since only a few herds- 
men react positively to the cfforts, the herdsmen are not allowed 
to graze on land wherever or whenever they wish thus forcing them 
to setue. 

By 1982 the meat-packing plant has been established and most 
herdsmen have reluctantly settled. The multi-national company 
pays the herdsmen high prices for their cattle. The middlemen find 
chemselves being forced out of their traditional supply links. The 
micdlemen, who handle many foodstuffs other than beef, organize 
into 2 cohestve unit and in 1985 go on strike. There is mass hoard- 
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ing of food by housewives and prices increase remarkably. The 
military is asked to provide trucks for the transportation of es. 
sential foodstuffs... . 


Several such scenarios were formulated for review and 
evaluation by the decision maker. 


THEORY 


Scenarios are constructed based on a planning philo- 
sophy which might be called “furures-creative” (Gerardin, 
1973). Scenarios are effective decision aids if the decision 
maker accepts such a planning philosophy. A future is to 
be designed which is in line with stated goals. A future will 
not be accepted if it is simply an extrapolation or exten- 
sion of past events. 

Scenarios have been used widely and are especially use- 
ful for policy making. Kahn and Wiener (1967) con- 
structed scenarios for international political systems. 
Durand (1972) and Gerardin (1973) recorded several ap- 
plications in France, including regional development plan- 
ning. Kraemer (1973) cites a study in urban planning. 
Brown (1968) describes political scenarios done at the De. 


partment of Defense. 
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Delphi 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 

The Delphi is a group process technique for eliciting, 
collating, and generally directing informed (expert) judg- 
ment towards a consensus ona particular topic. 


USES 

The Delphi may be used in: 

1) Establishing goals and their priorities. — 

2) Identifying the dimensions and the attributes of a 
problem. 

3) Providing forecasts (e.g., identifying future devel- 
opments and their effects). 

4) Clarifying positions and delineating differences be- 
tween group members. 

5) Gathering information from a group whose mem- 
bers do not meet face-to-face (either by choice or practi- 
caliry) and wish to retain their anonymity. 


SHORT DESCRIPTION 
The Delphi is a method whereby individuals are al- 


lowed to focus on and debate issues anonymously. The 


study is typically conducted by mail through several 
rounds of questionnaires (QTN, page 19). The results of 
each round are collected, collated, and analyzed by a de- 
sign team. Based on this analysis, questions for the subse- 
quent round are developed. The Delphi generally pro- 
motes convergence of opinions, although it may provide 
the basis for disagreement. 


ADVANTAGES 


1) The anonymity provided by the Delphi precludes 
some undesirable aspects of face-to-face communication, 
such as dominance by certain personalities and inhibition 
of expression. 

2) A Delphi participant may respond with opinions 
which more truly represent his or her feelings. 

3) Individuals who may not otherwise afford the time 
required for a group meeting may participate. 

4) With the Delphi, a large heterogeneous group can 
participate on an equal basis. 

5) The Delphi is obviously useful when the respon- 
‘dents are geographically scattered. 


LIMITATIONS 


1) The Delphiis precluded when there is a limited time 
available to aggregate participants’ judgments, because of 
the delay in gathering and assimilating responses. 

2) The Delphishould not be used with individuals who 
have difficulty reading or expressing themselves in written 
communication, 


3) High participant interest and commitment is as- 
sumed or the quantity and quality of responses decreases 
with successive rounds, 

4) Desirable features of a group meeting, such as in- 
stant communication and intellectual stimulation, are 
compromised. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


The design team will have to spend a significant amount 
of time designing questionnaires and analyzing completed 
questionnaires. Integration between the decision maker 
and Delphi design team is necessary to ensure that the 
goals or requirements of the decision maker are under- 
stood by the design team. 


SKILL LEVEL 


The design team must be able to establish unbiased 
questionnaire designs which relate the Delphi exercise to 
its purpose (see QTN, page 19). The feedback of com- 
ments and reactions to the respondents should be succinct 
and representative without reflecting the bias of the design 
team. Members of the design team who are knowledgeable 
in the subject matter greatly facilitate this crucial process. 


TIME REQUIRED 

Approximately six weeks are required to complete a 
Delphi exercise which consists of four rounds of question- 
naires {see figure 1). Since eight days are allowed for each 
set of responses (including three days for dunning), the 
Delphirequires only about two weeks of actual effort. 

The continual motivation of the respondents is impor- 
tant in order to get a quick response and good return per- 
centage. Consequently, the design team needs to minimize 
the delay between receipt of questionnaires and trans- 
mittal of the next one to participants. Analysis of.the re- 
turned questionnaires and design of the subsequent ques- 
tionnaires should begin immediately rather than waiting 
unti] the expected return for each round. 


DESCRIPTION OF TOOL 


DEFINITIONS 
1: Dunning is the process of recontacting participants 


who have failed torecurn their questionnaires. 
2; A target group is a set of persons with certain com- 
bout 2 particular problem, or farmers with land in the 


aun 


same river basin. 
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REQUIRED INPUTS 
Since Delphi is a tool to aid decision making, it will be 
most effective if the decision maker is involved through- 


out the process. 
Respondents should be considered who: 


1) Have special experience or knowledge to share; 
2) Representa cross-section of opinions;and 
3) Can be motivated to participate. 


The size of the design team will vary from two to five, 
in direct proportion to the size of the respondent group. 
Delbecy, et al. (1975) found that, in their experience, 
30 well-chosen respondents were sufficient: few addi- 
tional ideas were generated by having more participants. 
About 15% of the selected participants will decline. 

For the questionnaire to communicate successfully, 


the questions should: 


1) Beas shortas possible. 

2) Be adapted to the language most familiar to the re- 
spondent’s area of expertise (e.g., health or education). 

3) Elicit useful responses at the level of abstraction re- 


quired (i.e., general vs. specific}. 


TOOL OUTPUT 


The output of the Delphi exercise will generally be a 
convergence of opinion. 

One type of output may bea frequency distribution or 
histogram of forecasts (see HIS, page 131). For example, 
the zespondents may estimate what the lege] minimum 
wage should be for the country of Temasek in 1980 in 
order to ensure adequate housing and food for citizens. 
The frequency distribution graph in figure 2 indicates that 
an interval of $75 to $100 was favored by most re- 
spondents as the desirable minimum wage. It also shows 
that a great majority of the respondents would not set a 
minimum wage below $75. The mean and standard devia- 
tion may be computed for the responses and added to the 
graph (HIS, page 131). 

Another type of output is the ranking of responses toa 
particular question. For example, the respondents may list 
the problems they perceive in the health field. The output 
is a vote on the importance of the problems. 


METHOD OF USE 


GENERAL PROCEDURE 


Delbecq, et al. (1975) recommend that the following 
steps be followed in designing and implemen ting a Delphi 
exercise. This procedure is only one way in which a De!phi 
exercise may be carried out. The number of rounds of 


FIGURE 1 
Schedule for Delphi 


Minimum Time Required 


Activities 
1. Develop problem statement “a day needles 
2. Select respondents ¥2 day 
3. Contact respondents 2 days 
4. Develop questionnaire #1 and test ¥, day 
5. Type and send out Hae SE Gay 
6. Response time 5 days 
7. Dunning time (if used) 3 days 
8. Analysis of questionnaire #1 2 day \ 
9. Develop questionnaire #2 and test Ys day two days . 
10. Type and send out 1 day 
11. Response time 5 days 
12. Dunning time (if used) 3 days 
13. Analysis of questionnaire #2 “, day 
14. Develop questionnaire #3 and test Y% day two days 
15. Type and send out 1 day 
16. Response time 5 days 
17. Dunning time (if used) 3 days 
18. Analysis of questionnaire #3 ¥, day 
19. Develop questionnaire #4 and test “2 day two days 
20. Type and send out 1 day 
21. Response time 5 days 
22. Dunning time (if used) 3 days 
23. Analysis of questionnaire #4 1 day 
24. Prepare report 1 day 
25. Type report and send out 1 day 
26. Prepare respondents’ report "2 day 
27. Type report and send out | 1 day 


The minimum time is 47 days, allowing 8 days (including dunning) for each response. 


SUUREE: Andre Delbecq et al., Group Techniques for Program Planning: A Guide to 
Nominal Group and Delphi (Chicago, Ill.: Scott Foresman, 1975), p. 87. 


FIGURE 2 
Frequency Distribution of Estimates of Minimum Wage 
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questionnaires, the types of questions, the responses re- 
quired, and the analyses performed will vary depending on 
the ty pe of application and the actual situation. 


1. Determine the basis for a Delphi. 


13 


Liz 


id 


A statement of objectives or problems is de- 
veloped by the decision maker in cooperation 
with the rest of the design team. 

Target groups of respondents (e.g., agricultural 
economists, engineers, planners, etc. in an agri- 
cultural development exercise) are generated by 
the design team. Names of potential respon- 
dents are then identified. 

Telephone or personal contact is made with the 
potential respondent. The respondent is in- 
formed of the objectives of the Delphi, the 
nature of the respondent group, the obligations 
involved, how long the Delphi will take, how 
the Delphi works, and how his or her participa- 
tion will be mutvally advantageous. The safe- 
guards on anonymity may be explained. 


2. Design questionnaire 1, 
941 The initial task of the respondents is generally 


to generate a list of items. Examples of such 


items would be barriers to delivery of serve 
perceived problems, or potential developmie. 


2.2 The design team formulates wictions whic:. «. 
consistent with the statement wf objective: 


Questionnaires, QTN, page 1%), 


2.3 A short cover letter outlines (he task arc . 
iterates the agreement reachevl in the initia! — 


tact with the respondentin step, 4, 


3. Solicit responses for questionnaire !/}_ 


3.1 If possible, the questionnair« j: pretested » 
sure that questions are not Nilsinterpretec 
group may be composed ol s-ycra] ty pica 
spondents from the Delphi prvwiyy, 

3.2 The questionnaire and cove: Irtter are dis 


uted to all respondents. Retin of the «-. 


pleted questionnaires should be prearre:... 
(e.g., by enclosing self-addi: ssc stampe< 
velopes). 

3.3 If sufficient questionnaires ait notreturse: . 
the specified date, dunniny, i carefully «. 
posed reminders, should lv ilirected tx 


Delphi group. A response rate uf 85% iss. 
considered acceptable. 


| 
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4. Analyze questionnaire #1. 
4.1 Responses are copied and cut into slips so that 


each member of the design team has a set for 
each question. For example, for the question, 
‘What agricultural developments do you fore- 
see for Temasek in the next 15 years?” the slips 
may read “more effective fertilizers,” “lining of 
irrigation ditches with concrete,” etc. 

Each member sorts the response items for all 
questions into stacks representing similar re- 
sponses to a question. The stacks are then 
labeled, e.g., for agricultural development, “‘Ir- 
rigation,” “Education,” “Technology.” 

A member of the team reads his stack of labels. 
Through group discussion, the design team 
agrees upon categories of responses. 

Response slips are reordered according to the 
category labels. Obvious duplications are elim- 
inated, and closely related items are combined. 
Statements expressing the resulting items with- 
in each stack are formulated. The result of this 
effort constitutes the list of items for question- 


4.3 


4.4 


naire =2. 


5. Design questionnaire =2. 

5.1 Questionnaire #2 should help respondents un- 

derstand, clarify, criticize, and support items 
identified in questionnaire #1. 
Several things may be asked of the respondent. 
He may be asked to forecast when a develop- 
ment may take place or if the items identify 
potential future developments. He may be 
asked to identify what impacts such a develop- 
ment might have, or he may be asked to vote on 
the items. The respondent is encouraged to pro- 
vide comments, e.g., he may state why he thinks 
a problem is important. 


5.2 


5.3 If the respondent is to vote on the items, the 


rank-order procedure may be used (see Nominal 
Group Technique, NGT, page 14). 


6. Solicit responses for questionnaire #2. 
Repeat step 3, including pretest and dunning (if 
necessary). 


7. Analyze questionnaire 72. 

7.1 The comments for each item are placed in 
stacks (see step 4) to be summarized and com- 
municated to the respondent in questionnaire 
=3. 

If voting has taken place, the results are ag- 
gregated and the items are ranked according to 


ngs Hj, st heme Ag. Rep S CAs Sy. .s « 
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8. 


10. 


iy. 
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14. 


their votes. [f quantitative forecasts have been 
made, a frequency distribution is consxuczed 
(see figure 2) and distributed to the respondents 
in the next questionnaire (see Histograms, HIS, 
page 131). 

7.3 The responses are reviewed to see if they are 
useful in achieving the objectives set up in ste; 
1. If necessary, the next questionnaire can te 
altered by encouraging a different kind of com- 


. Lf s4 
ment or by making responses more specilic. 


Design questionnaire =3. 

8.1 This questionnaire aims to explore disazree- 
ments identified in questionnaire =2. 
The results of step 7—the ranking of the items. 
the aggregated forecasts, and the summarized 
commen ts—are piven to the respondents. 
The cover letter informs the respondents that 
they should react to any questions and crit- 
cisms and should lobby fer or against items they 
feel strongly about. 


-_ = 


8.2 


8.3 


Solicit responses for questionnaire +3. 
Repeat step 3, though a pretest is seldom necessary. 


Analyze questionnaire $3. 

The design team reviews the reactions to the com- 
ments and summarizes them ina procedure similar to 
that outlined in step 4. 


Design questionnaire +4 (optional). 

11.1 This isa final attempt towards consensus. 

11.2 Questionnaire +4 is similar to $3 except thatit 
also provides a summary of respondents’ reac- 
tions. 

11.3 The respondents consider the final reactions 
and are asked to provide a vote or quantitative 
forecast similar to that indicated in question- 
naire +2. 


Solicit responses to questionnaire +4 (optional), 
Repeat step 3, omitting the pretest. 


Analyze questionnaire #4 (optional). 
The rankings are totaled for each item to identify its 
importance. Where forecasts were made, final fre- 
quency distributions are constructed. 


Closure. 
The participants are informed of the results to pro- 
vide a sense of closure. 


VII 
Analyzing Projects 


Cash Flow Analysis 
Discounting 
Net Present Worth 
Benefit-Cost Ratio 
Internal Rate of Return 
Impact-Incidence Matrix 
Cost-Benefit Analysis 
Cost-Effectiveness Analysis 


The financiai and economic analysis of projects requires the synthesis of many tech- 
niques. The primary process is the weighing of project benefits against the costs (Cost- 
Benefit Analysis). The time stream of benefits and costs must be considered (Cash Flow 
Analysis) and weighted (Discounting) in order to make project alternatives comparable. Dis- 
tribution effects are an essential factor in a systems approach to economic analysis (Impact- 
Incidence Matrix). Various criteria are used to decide the merits of projects (Net Present 
Worth, Benefit-Cost Ratio, and Internal Rate of Return). 

The effectiveness of projects (or systems) is weighed against costs (Cost-Effectiveness 
Analysis) to evaluate the degree to which various alternatives achieve given objectives. This is 
a criterion not unlike those used for analyzing benefit-costs, except that benefits are not 


valued in monetary units. 
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EXAMPLE 

In dealing with a country’s economy, the decision 
maker determines that continued inflation is a major prob- 
lem. To combat the problem, he must identify the factors 
causing inflation and its effects. Target groups may be 
economists, corporation heads, consumer advocates, trade 


union leaders, and agricultural experts. 
Questionnaire #1 asks, ‘What are the factors which 


_ may contribute to inflation over the next five years?” The 


respondents answer by listing several items they feel are 


im portant: ; 
Increase price of oil 


Strengthen border defenses 
Shortage of rice 


Questionnaire #2 lists al] the responses, and each re- 
spondent provides comments and votes by giving each 
item a numerical value which corresponds to the im por- 


tance of thatitem. 


Item Vote Comments 
Increase price 3 If new sources of oil 
of oJ are found, price 

increase may be less 
Strengthen defenses 0 High likelihood of 
on border military aid from 

another country 
Shortage of rice 4 Import prices and 


number of tons of 
rice imported 
will increase 
The responses for questionnaire #2 are analyzed. The 
votes are ageregated and comments are summarized. Ques- 
tionnaire +3 asks for reactions to the aggregated votes and 
comments. One respondent’s reaction may be: 


Item Vote Comment Reacoon 
Strencthen 153. High likelihood The other country 
defenses of military aid failed to support 
on border from another Our country last 


country year despite 
previous pledges 


DELPHI 


Questionnaire #4 then circulates all reactic 


asks for a final vote. 


THEORY 


A number of theoretical arguments have been: 
support the claim that the Delphi method is sup 
conventional uses of groups in problem solving « 
casting. In 1964, Gordon and Helmer laid the foun 
for the Delphi. Delbecq, et al. (1975) compar 
characteristics and performances of interacting, nc 
and Delphi groups. Dalkey (1969) provided en 
arguments for the relative accuracy of Delphi est 
compared to individual or face-to-face group estima 
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VIII 
Analyzing Projects 


Cash Flow Analysis 
Discounting 

Net Present Worth 

Benefit-Cost Ratio 
Internal Rate of Return 
Impact-Incidence Matrix 

Cost-Benefit Analysis 
Cost-Effectiveness Analysis 


Impact- 
Net Present 


The effectiveness of projects (or systerns) is weighed against costs (Cost-Effectiveness 
Analysis) to evaluate the degree to which various alternatives achieve given objectives. This is 
a critericn not unlike those used for analyzing benefit-costs, except that benefits are not 


valued in monetary units. 


te 
ees, 


Cash Flow Analysis 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 

Cash flow analysis determines the difference between 
the incremental costs and the incremental benefits for 
each year of a project in order to evaluate its financial 


viability. 


USES 

Analyzing cash flows: 

1) Provides an overall picture of the costs and benefits 
accruing from a project over the estimated life of the 
project. 

2) Enables calculation of the total cash flow or the net 
mcremental benefit of the project. 

5) Indicates any negative cash flow years which may 
affect project viability. 

4) Provides the basis for calculating measures which 
account for the time value of money (e.g., Net Present 
Worth, NPW, page 188: Benefit-Cost Ratio, BCR, page 
194; and Internal Rate of Return, IRR, page 200). 


KEY DEFINITIONS 


1) Incremental costs and benefits are computed by 
subtracting the ‘Without project” values from the “with 
project” values. They represent the changes the project is 
expected to produce compared to what would otherwise 
occur. Note that this is not the same as computing “be- 
fore” and “after” project values, since conditions may be 
predicted to change whether or not the project is imple- 
mented (see Sirken, or Gittinger, 1972). 

2) Annual cash flow is the net incremental “benefits” 
for each year of a project and the difference between the 
incremental benefits and costs. 

3) Total cash flow is the sum of annual cash flows for 
the life of the project. It is an undiscounted measure* of 
the aggregate change expected from implementing a proj- 


ect. 
4) Financial analysis is done from the viewpoint of the 


individual, group, or business which will directly gain or 
lose because of the project. All costs and benefits are 
valued at market prices. 

5) Economic analysis is done from the viewpoint of 
the national government and the economy. Taxes, inter- 
est, custom duties, etc., are excluded from the calculation 
of costs and benefits, and labor and foreign exchange may 
be shadow-priced. 


“In contrast to net present worth or other discounted measures 
(sce DIS, page 184), 


FIGURE1 
Graphic Illustration of Cash Flow for a Project 
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6) Shadow prices are adjusted market prices which re- 
flect the true benefit or cost to the economy, e.g., the dif- 
ference between the market (subsidized) price of fertilizer 
and the world price the government must pay. 


SHORT DESCRIPTION 

Cash flow analysis is a central part of the financial and 
economic evaluation of projects. Distinguishing between 
“with project” and ‘‘without project” benefits gives the 
incremental benefit (Gittinger, 1972) and the changes in 
benefits that are projected during each year of the project. 
Incremental costs are computed using the same distinc- 
tion. 

The annual cash flow is the difference between incre- 
mental benefits and incremental costs in that year. A 
typical project has an early negative and a later positive 
cash flow when the incremental benefits exceed incre- 
mental costs (see figure 1). 

Cash flow analysis for development projects distin- 
guishes between financial and economic analysis (see 
Cost-Benefit Analysis, CBA, page 212), This distinction 
affects the identification and estimation of project costs 
and benefits. Otherwise, the subsequent computation 


procedure is the same. 


ADVANTAGES 

Cash flow analysis shows the changes that the project is 
expected to bring about in both increased benefits and in- 
creased costs. There may be changes in the amounts of 
benefits or costs as well as in the sources (USDA, 1971). 
The project may replace an existing service or production 
arrangement whose costs and benefits represent the “with- 
out project” financial situation. 

The total cash flow for a project gives an indication of 
the performance of a project during its life. 

A negative annual cash flow may indicate financing 
problems for the project, and credit may need-to be 
arranged. 


LIMITATIONS 


The annual cash flow of a project is an aggregated mea- 
sure of the complex interaction among gross benefits and 
costs fom ‘with project” and “without project” esti- 
mates. As a consequence, many assumptions about indi- 
vidual project-induced changes in the environment may be 
los: in the aggregate data. 

The total cash flow for a project fails to account for the 
cme value of money. Cash flow analysis does not account 
for benefits or costs which cannot be assigned a monetary 
value ‘e.g.. good will, customer confidence, or a farmer’s 


sense of secunty) 


. 
‘ 
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REQUIRED RESOURCES 


LEVEL OF EFFORT 

Cash flow analysis demands extensive data gatherin, 
and forecasting of costs and benefits. These tasks shoul 
not be underestimated, particularly since cash flow analy 
sis is usually the first step in a sequence leading to an analy 
sis of the economic and financial feasibility of a project. 


SKILL LEVEL 

Skills in cash accounting, balanced by the ability to 
judge future disbursements, are essential. If data are avail. 
able, the subsequent computations are rather mechanical, 
But at all times the meaning behind the figures must 
temper their use. This is undoubtedly a skill which must be 
learned from analyzing related projects in similar en- 


vironments. 


TIME REQUIRED 

Several days to several weeks may be required for data 
gathering. A longer period is necessary if a survey is in- 
volved (SVY, page 36). The analysis should not require 
more than a fewhours. 


SPECIAL REQUIREMENTS 


Budgetary data and computation devices (e.g., hand 
calculators) are useful. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


Cash flow analysis requires an estimation of costs and 
benefits over the life of a project. Where accounting infor- 
mazion is available and reliable, the determination of capi- 
tal and operating costs and projected profits is straight- 
forward. However, the indirect costs and benefits which 
may not be easily derived require considerable astuteness 
and information-gathering. 


TOOL OUTPUT 


Cash flow analysis gives a pattern of benefits and costs 
which can be analyzed directly to influence investment de- 
cisions (figure 1). For example, if a cash flow in any year is 
negative, the project may have to be redesigned or credit 
may have to be provided. Typically, however, the data will 
be used to compute other criteria of economic feasibility, 
e.g., the Net Present Worth (NPW, page 188) and the Bene- 
fit-Cost Ratio (BCR, page 194), 
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IMPORTANT ASSUMPTIONS 

It is assumed that the relevant costs and benefits have 
been identified and quantified in monetary units. Where 
this is impossible, the cash flow analysis gives only an ab- 
breviated picture of an investment decision. Other mea- 
sures, such as Cost-Effectiveness Analysis (CEA, page 
219), must then be used. 


METHOD OF USE 
GENERAL PROCEDURE 


1. Identify the cost and benefit components of the proj- 
ect. Identify the target population—the people who are 
to directly benefit from the investment or project (see 
Impact-Incidence Matrix, IPX, page 207). 

1.1 List the costs which will be changed as a result of 
the project. These include changes in the costs of 
goods, services, labor, and management identified 
by contrasting the ‘‘with project” and the “with- 
Out project” situation. The ‘without project” 
costs are zero if the investment is not replacing a 
current practice or productive enterprise. 

1.2 List the categories of benefits which will be 
changed as a result of the project. Increased pro- 
duction efficiency, higher yields, and more mar- 
ketable products contrast ‘with project” benefits 
with the “without project” benefits. 

1.3 If the cash flow analysis is part of a financial anal- 
ysis of the project, identify the costs and benefits 
which affect the individual, cooperative group, 
enterprise, or target population. These include 
taxes, the subsidized prices of inputs, and the pre- 
vailing market prices for yields. 

1.4 If the cash flow analysis is part of an economic 
analysis, identify the costs and benefits for the 
target population which represent areturn or cost 
to the whole society. Taxes are excluded,*-and the 
unsubsidized price of inputs and the world prices 
of exportable produce are used. Shadow prices 
must be determined for imported goodsand labor 
(see Gittinger, 1972), 


tu 


Determine the life of the project or the time span of 

analysis. 

2.1 Estimate the effective life of any major capital 
equipment, e.g., tractors, pumps, buildings. 

2.2 Estimate the probable time span for the full reali- 
zation of benefits. 


“sane: are nota net benefit to the economy as a whole, only a 
transfer of resources within the society, 
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2.3 Select a project life based on these estimates , 
the knowledge that costs or benefits occurring 
more than 20 years have little effect on crit, 
such as net present worth. The discounted va), 
(see Discounting, DIS, page 184) are small in 
lation to values in the first decade of a project, 


3. Estimate the gross costs and benefits during each pr 


ect year. 
3.1 Estimate all quantifiable costs and benefits DI 


jected for each project year and enter in a tal 
(see figure 2). These are the “with project” valu 
A convenient accounting convention is to assur 
that all costs and benefits are paid at the end of t 
year in which they occur. 

3.2 Estimate the ‘‘without project” costs and benef 
which will hypothetically occur if the current sit 
ation continues in the absence of any investme: 
project. It may be necessary to conduct a survey | 
determine the average costs and benefits accruis 
from current practices of the target populatic 
(see Surveys, SVY, page 36). Enter these estimat: 
in the table (see figure 2). 


- Compute the incremental costs and benefits of th 


project for each year. 

4.1 Subtract the “without project” benefits from th 
“with project” benefits to give the increments 
benefits for each project year and enter in th 
table asa change due to the project. 

4.2 Subtract the gross “without project” costs fron 
the gross “with project” costs to give the incre 
mental costs for each project year and enter in the 
table asa change due to the project. 


- Compute the annual cash flows or net incremental 


benefits. 

5.1 Compute the annual cash flows by subtracting the 
incremental costs from the incremental benefits to 
give the net incremental benefit. 

5.2 Compute the total cash flow for the life of the 
project by summing the annual cash flows. The 
computations in steps 4 and 5 are illustrated in 


figure 3. 


. Diagram the annual cash flows (optional). 


6.1 Plot the incremental costs (cash outflow) and 
benefits (cash inflow) (see figure 1), 

6.2 Plot the net incremental benefits (annual cash 
flow) to reveal the fluctuations in benefits which 
may occur throughout the project life. (These 
g-aphs are particularly useful in computing the 
Internal Rate of Return, IRR, page 200.) 
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FIGURE 3 
Computing the Net Incremental Benefit or Cash Flow Resulting from a Project 


C 


Increment 4 


Incremental Cost 


CASH OUTFLOW 


EXAMPLE 


A small farmer in Temasek (average holding of seven 
acres) has an average annual production cost of W100 (WU = 
Unis, the Temasek currency note).* These costs include 
land preparation, cultivation, seed, and other production 
inputs. The current annual benefits were W160, giving the 
farmer a net profit of W60 per year. 

The Ministry of Agriculture wanted to introduce small 
walking tractors (five to ten horsepower). A technical 
analysis of power requirements indicated that such a trac- 
tor would enable the farmer to cultivate more intensively 
(e.g., double cropping) and to expand his holdings, in- 
creasing his production by 200% (see Balis, 1974). This 
would eventually lead to a W360 rise in annual benefits 
with corresponding production costs of Y130.** Tractor 
costs were initially a Y500 investment with 50 for opera- 
tion and maintenance per year. The estimated life was ten 
years with no salvage value. 

The Ministry of Agriculture field staff prepared a finan- 
cial cash flow analysis from the viewpoint of a typical 
farmer (see figure 2). By accounting convention, all costs 
and receipts were assumed to be paid at the end of each 
year. For example, the purchase price of the tractor was 
listed as an expense for the first year. 

A diagram of the annual cash flows was constructed to 
clarify the components of the net incremental benefits. 
The analyst noted thar, in the first year, the farmer would 
have a negative cash flow of W380. Therefore, many 
farmers needed financial assistance to purchase the trac- 
tor. Feasible loan arrangements were included in subse- 
quent cash flows analyses. The interest costs of borrowing 
money were entered in the gross “with project” costs. 


“In this example, the analysis is financial rather than economic, 


Le., the cost estimates are all based on market values. 


*“It was assumed that the increase in seed, fertilizer, and other 


costs would be countered by a reduction in labor costs. 


Gross Benefits Net 
en —l CC. ama 


Incremental Benefit 
CASH INFLOW 


2B —AC 
Net Incremental Benefit 
CASH OUTFLOW 


The net incremental benefits were estimated at £700 
over the ten-year tractor life. Since the farme would make 
W700 more than he would otherwise, the project seemed 
to be justified.” 

The economic analysis of the farmer's tractor purchase 
option would look at the target group as a whole and the 
impact of the tractor purchases on the eccncmy as a 
whole. This analysis involves many assumptions about the 
effective shadow prices for necessary farm inputs ‘e.g., 
fuel for the tractors and spare parts), the cost of labor, and 
effects on foreign exchange. This is beyond the scope of a 
non-economist. The reader is referred to the many texts 


on economic analysis (e.g., Gittinger, 1972). 


THEORY 


Cash flow analysis conceptualizes a stream of cash 
flowing out of a project or enterprise and an incoming 
stream. The cash outflow pays for capital goods, services, 
management, and labor for the project. The cash inflow is 
the benefit stream or returns to the project. The net cash 
flow, the difference between cash inflow and outflow, 
describes the dynamic transactions of the project at yearly 
intervals. 

The description of cash flow analysis is drawn largely 
from Gittinger (1972) and the Economic Development 
Institute of the World Bank. The distinction between 
“with project’? and ‘without project”’ situations is less 
critical than the difference between financial and eco- 
nomic analysis. If necessary, ‘without project” values can 
be incorporated into the determination of the benefits 
expected from the project (e.g., reduced labor costs 
brought about by a product can be treated as an incre- 
mental benefit of the project). 

However, the difference between financial and eco- 


nomic analysis significantly affects the inputs to the cash 


"This example is continued through a sequence of project 
analysis tools ending with Cost-Benetit Analysis. 
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flow analysis and the conclusions which may be drawn 
from the results. Adjustment of market prices by using 
shadow prices or some other multiplier is a complex pro- 
cess (see, for example, Bruce, 1976; Little and Mirlees, 
1968; Squire and van der Tak, 1975; and Weckstein, 
1971-72) and is the subject of some debate. 
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Discounting 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


Discounting provides a basis for analyzing and compar- 
ing future streams of costs and benefits by reducing them 
to their equivalent present worth. 


USES 

1) Future payments, either single, auniform series (an- 
nuity), or an irregular series can be converted to their 
present worth by using discount factors computed from 


an appropriate discount rate. 

2) The difference between payments made now and 
payments made in the future can be translated into acon- 
stant discount rate to measure the preference for present 


as opposed to future benefits. 
3) Discounting permits inclusion of time preference in 


analyzing the net value of a single project, and in compar- 
ing two or more projects with dissimilar time-streams of 


costs and benefits. 


KEY DEFINITIONS 
1) Present worth is the value today of a future pay- 


ment. 


2) Discount rate is a percentage rate (usually annual) 
which equates the present and the future worth of a pay- 
ment. 

3) Adiscount factor is a fraction between zero and one 
which gives the present worth of one monetary unit spent 
or received. 

4) Time preference is the general preference of individ- 
uals for present over future receipts and for future over 
present expenditures. 

5) Opportunity cost is the cost of committing re- 
sources to a particular use as measured by the highest re- 
turn that could have been obtained by committing the 
same resources to an alternative use. 


SHORT DESCRIPTION 


Discounting is a process of converting a single future 
payment or series of future payments to their equivalent 
present worth. The computation requires specifying a dis 
count rate from which a discount factor may be deter- 
mined. 

Discounting future payments accounts for the time 
preference for present rather than future benefits. By dis 
counting, payments that occur at various times through. 
out the life of a project can be made equivalent to present 
payments. A complex flow of payments can be converted 
to a single net figure, facilitating the valuation of one 
project or a comparison between projects in a way that 
reflects time preference and opportunity cost. It is the 
reverse of the compound interest process. 


nd SFR nn ee, 


ADVANTAGES 

1) Discounting provides a logical basis (time prefer- 
ence-oppo: tunity cost) for comparing paymentsat various 
times. It facilitates the valuation of a single project ora 
comparison between projects. 

2) Discounting puts more value on near-term than on 
distant payments. Since more distant forecasts are pener- 
ally less reliable than short-term forecasts, discounting in- 
creases the degree of confidence that the analyst may have 


in his valuation. 


LIMITATIONS 

1) Establishing the discount rate is a theoretically 
complex and practically difficult chore. It may be based 
on the longterm market interest rates on relatively safe 
investments, e.g., government bonds are investment secur- 
ities after taxes. Most analysts would argue that this is too 
low, and the discount rate should be estimated from the 
Cpportunity costs of capital (DeNeufville and Stafford, 
1971). Gitinger (1972, page 90) reports that most 
countries use discount rates of 8% to 15% in their 
analysis, with 12% being used most often. In practice, a 
high rate is preferable to a low one. 

2) The choice of a particular rate will influence the 
attractiveness of a project and may determine the ranking 
among alternative prospects. It is often desirable to repeat 
the analysis with varying discount rates, all of which are 
considered reasonable on some basis. If the results differ 
widely, the decision maker should be made aware of the 
significance of the choice of rate. 

3) The eppropriate discount rate, like other interest 
rates, migh: be expected to vary over time; yet discounting 
generally reats the rate as a constant parameter. It is, of 
course, possible to use varying discount rates for varying 
future periods if you have a basis for making such detailed 


forecasts. 


REQUIRED RESOURCES 
LEVELOF EFFORT 


Discour=ng can be time consuming, but it isnot a diff. 
cult cask, Fisst. the appropriate discount rate must be de- 
cermined Then the discount factor is either computed or 
read from zbles, Finally, the present worth js computed 
Sy multiplying the future payment by the discount factor. 
A pocket cz!=:)stor and pretabulated discount factors re- 
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SKILL LEVEL 
Establishing the appropriate discount rate rec 
some expertise and subjective judgment. The opport 
cost of capital must be estimated, requiring a know 
of the best return from alternative sources of investn 
The rest of the discou nting process is rather mecha 
and has a built-in self-checking process (see General P. 


dure). 


TIME REQUIRED 

The time required to discount a series of payments 
function of 1) the number of payments, 2) whether t 
are uniform or irregular, and 3) the availability of calc 
tors and discount tables. This time is insignificant ec 
pared to the effort and time required to estimate thec 
flow of future payments (see CFA, pege 177). 


SPECIAL REQUIREMENTS 
A pocket calculator and a set of discount tables n 
only speed up the process, they help to eliminate simy 


errors in computation. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) DF [r/n] = discount factor of an amount paid ; 
end of yearn at rdiscountrate (%). 
2) ADF [r/n] = annuity discount factor at r discour 


rate (%) for n years. 
3) PW [r/n] = present worth at discount rate r (%) o 


amount paid during n years. 

For example, PW [15%/10] =-500 DF [15%/1] + 12( 
ADF [15%/10] is the present worth (at a discount rate o: 
15%) of a single disbursement of 500 units at year 1 anc 
receipts of an annuity of 120 units for 10 years. 


REQUIRED INPUTS 

Computing the present worth requires: 

1) The specification of the appropriate discount rate 
(see, for example, Hinrichs, 1 969). 

2) A tabulation of the future payments (costs or bene- 
fits) for each year (see Cash Flow Analysis, CFA, page 
ery 


TOOL OUTPUT 


Discounting gives the present worth of a Aiture pay- 
ment or stream of payments. This discounted value can be 
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used to compute financial criteria for project evaluation: 
1) the net present worth (NPW, page 188); 
2) the benefit-cost ratio (BCR, page 194); and/or 
3) the internal rate of return (IRR, page 200). 
Any one of these measures may be used in the cost- 
benefit analysis of a single project or multiple projects. 


IMPORTANT ASSUMPTIONS 


Discounting reflects the preference for benefits now 
rather than at some later time. This time preference as- 
sumes that there is an opportunity cost in waiting to re- 
ceive the benefits. One cost is the opportunity to invest in 
an alternative project which will yield a greater return than 
the amount invested. The second cost is the uncertainty of 
receiving delayed payments. The risk increases with the 


period of delay. 


METHOD OF USE 


GENERAL PROCEDURE AND EXAMPLES 


Discounting a Single Furure Payment 
1. Determine the discount rate, r (see Net Present Worth, 
NPW, page 188). 
2. Compute the discount factor, DF [r/n]: 


DF(r/n] = 1/[1+(r/100)]” (1] 


where 
n = number of years hence that the payment 
will occur 
r = discount rate (%) 


Or, determine the discount factor from the appropriate 
discounting table (see Gittinger, 1973).* 


3. Multiply the discount factor by the payment amount 
to get the present worth: 
PW = Payment X DF([r/n] [2] 


The present worth of a $200 payment five years hence 


FIGURE 1 
Computing the Present Worth of a 
Series of Nonuniform Payments 


Payment Discount Factor Present 
Year (or receipt) “ at 20% Worth 
/ suet EE ess 
1 (100) 0.833 (83) 
2 (100) 0.694 (69) 
3 200 0.579 116 
TOTAL 0 2.106 (36) 


*Negative amounts are shown in the table in parentheses. 


Discounting a Series of Nonuniform Payments 

1. Determine the discountrate,r. 

2. Construct a table which lists the year and the payment 
amount in each year (see figure 1). 

3. Determine the discount factor for each year at the ap 
propriate discount rate. 

4, Determine the present worth of each yearly payment 

5. Compute the sum of the present worths in order to give 
a single value. (Payments may be both negative expend- 
icures and positive receipts.) 


Two $100 expenditures were to be made in consecutive 
years in order to receive $300 at the end of the third year. 
The present worth of the three payments was computed 
by determining the present worth of each payment and 
summing (see figure 1). Two conventions were used: 1) all 
payments are assumed to occur at the end of the year 
(which means that the first expenditure must also be dis- 
counted); 2) expenditures are negative amounts (shown in 
parentheses) and receipts are positive. If the three pay- 
ments are summed, the investor gains $100. However, us 
ing a discount rate of 20%, the sum of the discounted pay- 
ments is only $22. A higher discount rate would further 
reduce the present value of the series of payments. 


Discounting an Annuity 


i nd 20%. ' . 
was computed for discount rates of 10%, 15%, a by. jHbeveniaihe che discodarncene 


Ata discount rate of 10%, the discount factor is: 
DF[10%/5] = 1/[1+(10/100)]* = 0.621. 


The present worth is: 
PW = ($200 X 0.621) = $124. 


The other discount factors are: 
DF[15%/5] = 0.497 
DF{20%/5] = 0.402, 


giving present worths of $99 and $80, respectively. 


*Discount factors for a single payment are always less than one. 


Usually, three signific 


ant figures are sufficient accuracy. 


2. Compute the annuity discount factor, ADF [r/n]: 


ADE[r/n] - 5 1/{1+(r/100)} (3] 


where 

al 

= = the sum of terms of index i, i ranging from 

vst 1 ton. 

n= the number of years for which the annuity 
is to be paid, each payment falling at the 
end of the year 

r = discount rate (%) 


Serene =, 


So ae ete 


The annuity discount factor may be computed from 
the single payment discount factor: 
[+] 


ADF[r/n]} = erate 


Or, the annuity discount factor* may be determined 


from discounting tables. 


3. Multiply the annuity discount factor by the uniform 
payment amount to get the present worth of the series 


[5] 


of future payments. 
PW (series) = payment X ADF [r/n] 


A series of five-year-end payments of $40 each were 
discounted to determine their present worth at a dis- 


count rate of 15%. 
The annuity discount factor was compu ted: 


15/100 0.15 


The present worth is: 
PW = ($40X 3.352) =$134, 


Discounting a Uniform Series of n Payments 
Which Have Been Delayed d Years 
1. Determine the discount rate, r. 
2. Determine the annuity factors: 
ADF [r/d] 
ADF [r/(n+d)]} 
where 
n= number of yearly payments 
d= years before first payment is made 
(n+ d) = yearin which final payment will occur 


3. Subtract the present worth of the payments made 
during the delay from the present worth of the pay- 
ments as computed from the present to the final pay- 
mentin yearn+d, 

PW = payment X ADF[r/(n+d)] ~~ 


— payment X ADF[r/d] [6] 


A project which hasa life of 15 years required an initial 
investment of $500 during the first year. The project will 
yield $1,000 in ten equal payments beginning six years 
later. If the discount rate is 12%, the present worth of the 
investment is: 

PW = $500X DF[12%/1] 
+ $100X ADF[12%/(5 + 10)] 
— $100X ADF[12%/5) 
= ($500X .893) + ($100 6.811) 
~ ($100 X 3.605) 
= $446 + $681 — $360 
= $767 
2 faster is often called the series discount factor or the uniform 


series discount factor. 


hana - : eee ee Ee ‘© 


DISCOUNTING / ] 


Note: Although present worths of future payments ca, 
summed algebraically, the discount factors alone Mayr 
e.g., ADF[r/(n + d)] - ADF [r/d] - ADF {r/n} . 


THEORY 

Discounting is the reciprocal process to compound 
an amount ata fixed interest rate. The discount rate ¢ 
responds to the interest rate mathematically. However, 
counting is used for analyzing projects, the discennt r. 
does not correspond to the interest rate on investme: 
savings. Interest on savings may be much lower thant 
return rate from a project. The discount rate is srlecteg 
correspond to the highest return available from alternat; 
investments. This represents the time value of mon 
(World Bank, 1975) as an Opportunity cost. The cost 
investments not made (the loss of a higher rate of retur 
figures prominently in the evaluation of Project: Using 
discounted measure of project worth. 

It is possible to evaluate cost and benefit Stresti-. at ar 
point in the life of the project. Discounting can he used 
determine the equivalent worth of Payments sfter tf 
analysis date, and compounding can be used tu dr. termi: 
the equivalent worth of payments Occurring befure th: 
date. The advantage of using discounting is that the yreate 
weight is placed on cost and benefit estimates jr, the Hee 
future. In fact, the discount factors for discount rate 
greater than 15% and more than 20 years in the future ar 
negligible. Consequently, these distant estimate: whic) 
tend to be increasingly uncertain) figure less in t},.. evalu 
ation of the project. 
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Net Present Worth 


PREREQUISITE TOOLS 


Cash Flow Analysis (CFA, page 177) and Discounting 
(DIS, page 184). 


USAGE 


PURPOSE 
Net present worth evaluates project net benefits by 
comparing different time streams of benefits and costs. 


USES 


Net present worth is used as: 
1) Acriterion for deciding if a single project should be 


funded. 


2) Acriterion for choosing among mutually-exclusive 


projects. 
3) An intermediate calculation in determining a proj- 


ect’s internal rate of return (IRR, page 200). 


KEY DEFINITIONS 
1) Discounted cash flow is a single value which repre- 
of the net incremental benefits es- 


sents the present worth 
year. It is computed by disc ount- 


timated for each project 
ing annual cash flows ata specified discount rate. 
ects are incompatible alter- 


ludes implementing the 


2) Mutually-exclusive proj 
natives~implementing one prec 


others. A project’s alternative time phasings may also te 
analyzedin this manner. 

3) Rank-ordering is the process of weighting one item 
against others and then ordering the items by weightona 


scale such as importance or priority. 


SHORT DESCRIPTION 


Net present worth measures a project's financial and 
economic viability by taking into account a time prefer- 
ence for money. The difference between “‘with project” 
and ‘without project” benefits and the similarly derived 
incremental costs determine annual cash flows (see CFA, 
page 177). The net present worth is determined from the 
discounted cash flow. Alternatively, computing the differ- 
ence of the project’s discounted annual incremental bene- 
fits and discounted annual incremental costs gives the net 
present worth. 

An appropnate discount rate must be selected in order 
to estimate the opportunity costs corresponding to de- 
layed benefits and alternative investments. A positive net 
present worth indicates that the projected return from the 
project investment is greater than the estimated opportu- 


nity to invest elsewhere. 


ADVANTAGES 


Net present worth reduces benefits and costs Occurring 
at different times to a com parable basis: the equivalent 


—<—_eo ef} 


a. oes 


9 - ene oe sm eee, 


value today. This permits comparison between alterna- 
tives and provides a decision rule for funding a single proj- 
ect. 
Net present worth estimates the amount that dis- 
counted benefits exceed discounted project costs. 


LIMITATIONS 

Investment decisions using net present worth as a cri- 
terion are often sensitive to the. choice of a discount rate. 
‘Consider, for example, two projects having identical bene- 
fit streams and equivalent total costs. A high discount rate 
favors the project having lower initial investment but 
high er an nua l costs; annual costs are weighted less heavily 
in the computation of net present worth. a : 

Net present worth gives the size of projected benefits 


from a project, but it gives no indication of how well the 
prdject uses the capital invesiment—the return oivespital 
Con sequently, net present worth is not a valid measure for 
ran k-ordering projects when funds are limited (Gittinger, 
ee i ee ae 


REQUIRED RESOURCES 


LEVEL OFEFFORT 

The major effort is in compiling the necessary cost and 
benefit data (see Cash Flow Analysis, CFA, page 177). The 
subsequent determination of net present worth is straight- 
forward once the appropniate discount rate has been deter- 
mined, 


TIME REQUIRED 


The first stages of identifying and estimating costs and 
benefits require the most time. The actual computation is 
easier with a simple hand calculator and appropriate dis- 
count tables (for example, Gittinger, 1973). See Discount. 
ing. DIS, page 184, 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


Computation of the net Present worth requires two pri- 
mary inputs: 

1} A description of the annual benefits and costs for 
the project (Cash Flow Analysis, CFA, page 177), 

2) Information on the Opportunity cost of capital in 
crCer to determine an appropriate discount rate (see Dis- 
counting, DIS, page 184). 


NET PRESENT WORTH / 


TOOL OUTPUT 


The technique gives a quantitative measure of th 
to be expected from a project measured in terms 
equivalent present worth. This criterion can then by 
for funding decisions. Net present worth is also an 
mediate calculation when determining a project’s in 


rate of return (IRR, page 200), 


IMPORTANT ASSUMPTIONS 

The net present worth criterion assumes that be: 
and costs can be discounted at a discount rate whic 
flects the opportunity cost of tying up project reso 
for the life of the project. 


METHOD OF USE 
GENERAL PROCEDURE 


1, Determine the incremental benefits and costs 
each year of the project (see Cash Flow Analysis, C 
page 177). 

2. Specify the discount rate (see Discounting, L 
page 184). 

3. Determine the present worth of the incremer 
costs by discounting each annual cost at the discount rz 

4. Determine the present worth of the incremen 
benefits. 

5. Compute the net present worth from the diff 


ay NPW = PW; — PW. 


where PWs is the present worth of incremental benef 
and PW. is the present worth of incremental costs. 


6. Apply the criterion to the evaluation of th 
project: 
a) If NPW is greater than zero, 


accepted. 
b) If NPW is less than zero, 


financially acceptable. 
c) If NPW equals zero, the project’s rate of retur 
is equal to the discount rate (see Internal Rate o 
Return, IRR, page 200). 
7. When comparing the net present worth for two o1 
more mutually-exclusive projects, select the Project with 
the greatest positive net present worth. 


the project 


the Project is nc 


EXAMPLE 

The annual cash flow for a small farmer tractor utili- 
zation project was computed in the Cash Flow Analysis 
technique (see figure 2, CFA, page 180), 
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FIGURE 3 
Net Present Worth Calculated from Discounted Cash Flow for Tractor Utilization—Rental Opdon 


GROSS 
Discount INCREMENTAL 


factor 
at 15% 


Net Present Worth: 


GROSS 
INCREMENTAL 
BENEFITS 
Y 


NET INCREMENTAL 
BENEFITS 
(CASH FLOW) 

) 


PRESENT WORTH 
OF CASH FLOW 


NPW = Sum of discounted annual cash flows for life of project = 100.2 = W100 


Computing NPW using annuity discount factor (see DIS, page 184): 
NPW = {20 ADF[15%/10] = (20)(5.019) = 100 


The net present worth of the project was to be calcu- 
lated using a discount rate of 15%, the assumed opportu- 
nity cost of capital. The calculations (see figure 1) gave 
a net present worth of W168. Since this measure was 
positive, the investment was financially sound. 

Farmers in this region also had the option of renting a 
tractor. The tractor and operator rental fee were estimated 
at W40 for a ten-year period. A cash flow analysis indi- 
cated an annual cash flow of W20 (see figure 2). The net 
present worth for this option was also calculated at a 15% 
discount rate by directly discounting the net incremental 
benefits (see figure 3)- The net present worth was pro- 


jected to te W100 for this option. 
Both options had a positive net presen 7 
farmer would gain more by purchasing the tractor since 


the discounted net benefit is greater. 


t worth, but the 


THEORY 


The analytical formula* for the net present worth is: 


NPW = hy (AB; — &C;) / {1 + (r/100)]' 
where 
n = number of years of the project 
OB; = gross incremental benefits of the project for 
yeari 
cC; = gross incremental costs of the project for year i 
r = discount rate (%) 


The formula may be modified to include varying dis 
count rates and inflation factors (Fleischer, 1972). But 


*See also figure 3, Cash Flow Analysis, CFA, page 182. 


each element is an estimate which requires careful judg 
ment by the analyst. The project life,n, must be estimated; 
the incremental benefits must be estimated and projected, 
often from sparse data of the “without” project situation. 
These estimates become more questionable as the project 
life increases. Finally, one must exercise caution in choos 
ing the appropriate discount rate for the analysis. 

Nevertheless, net present worth is a popular means for 
evaluating projects, partly because it corresponds to the 
commonly accepted notion of a time preference for 
money. Tradeoffs with other criteria are discussed further 
in Cost-Benefit Analysis (CBA, page 212). 


NET PRESENT WORTH / 


BIBLIOGRAPHY 
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Benetit-Cost Ratio 


PREREQUISITE TOOLS 


Cash Flow Analysis (CFA, page 177) and Discounting 
(DIS, page 184). 


USAGE 
PURPOSE 


The ratio of project benefits to project costs evaluates 


the efficiency of project resource utilization. 


USES 

Benefit-cost ratio is a criterion for project evaluation 
which is used to: 

1) Determine if a project should be funded. 

2) Determine the rank-ordering of several projects. 


KEY DEFINITIONS 

1) Rank-ordering is the process of weighing one item 
against others and then ordering the items by weight 
on a scale such as importance or priority. 


2) Project efficiency is the ratio of project outputs to 
inputs, e.g., the production rate for a given resource utili- 


ration rate. 


SHORT DESCRIPTION 


Benefit-cost ratios are computed by c 
e “without project’’ costs a 


omparing the 
“with project” to th nd benefits 


(see Cash Flow Analysis, CFA, page 177). The time prefer- 
ence-opportunity costs of money are weighed in the com- 
putation by discounting the benefit and cost streams (see 
Discounting, DIS, page 184). The benefit-cost ratio is the 
present worth of the gross incremental benefits divided by 
the present worth of the gross incremental costs. 

A benefit-cost ratio greater than one means that the 
project benefits exceed the project costs when discounted 
at the opportunity cost of capital. The size of the benefit- 
cost ratio reflects the efficiency of the project. Rank- 
ordering projects according to the benefit-cost ratio gives 
the highest priority to the project which uses resources 


most efficiently. 


ADVANTAGES 

The benefit-cost ratio reduces the investment decision 
to a single number which reflects the proportion of total 
benefits to total costs. When total resources are limited, 
rank-ordering projects by the benefit-cost ratio maximizes 
the return foreach investment dollar. 


LIMITATIONS 

The distribution of benefits and costs is not reflected in 
the benefit-cost ratio. One group in society may benefit at 
the cost of other groups (see Impact-Incidence Matrix, 


[PX, page 207). 


{ teens eens Ge eeemnas 


Precisely because the benefit-cost ratio reduces the cri- 
terion to a single dimensionless number, the individual es- 
timates, projections, and assumptions may be lost. Not all 
benefits can be quantified, nor expressed in monetary 
units, Hence, the benefit-cost ratio reflects only the eco 
nomic aspects of efficient resource utilization. 

If the projects are mutually exclusive, the benefit-cost 
ratio may give an erroneous ranking. A project may havea 
high benefit-cost ratio compared to other projects but a 
far smaller net present worth. Since the usual objective is 
to maximize the net benefit, the net present worth crite- 
rion is preferred for choosing between mutually-exclusive 


projects (see NPW, page 188). 


REQUIRED RESOURCES 


SKILL LEVEL 

Judicious use of the benefit-cost ratio requires an un- 
derstanding of the underlying assumptions used in the as 
sessment. Projects can be erroneously justified by subjec- 
tive selection of benefit and cost components, alternative 
valuations of the factors, and selective presentation of the 
results. The decision maker needs to recognize the rele- 
vance and accuracy of the analytic components. 


TIME REQUIRED 
The major time is spent gathering data. This may in 
clude surveying the project area to determine the “‘with- 
Out project” situation and gathering baseline data to pro 
ject the expected benefits of the project (see Surveys, 
SVY, page 36). The benefit-cost ratio computation for 
financial analysis is usually a straightforward calculation. 
An economic analysis requires more time as additional 
factors must be estimated (e.g., shadow prices for labor, 


foreign exchange, etc.). 


SPECIAL REQUIREMENTS 


A calculator and discounting tables simplify the com. 


Futation procedure. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 

The benefit-cost ratio requires accurate and reliable 
data on the relevant costs and benefits projected over the 
lize of the project. These cash flows (see CFA, page 177) 
must be estimated and discounted according to an as 
sumed discount rate. The latter requires information 
sdoutthe opportunity costs of canital. 


aa? 


BENEFIT-COST RATIO 


TOOL OUTPUT 

The ratio of benefits to costs provides a dimens 
criterion for financial evaluation of a projectand fc 
parison of alternative projects. The benefit-cost rat 
be used to redesign project components to im pro 


ciency. 


IMPORTANT ASSUMPTIONS 


All benefits derived from the project are ident: 
and measurable. The opportunity cost of capital is 
fied: if the benefit-cost ratio is less than one, the pro 
not returning as much as the best alternative inves: 


(assuming one exists). 


METHOD OF USE 
GENERAL PROCEDURE 


1. Determine the incremental benefits and costs o 
project for each year of the project life. 
The incremental! costs (benefits) reflect proje 
changes in costs (benefits) due to the project (see: 
Flow Analysis, CFA, page 177). 


2. Discount the annual incremental benefits and cos 
determine their present worth. 
An appropriate discount rate is selected in the 
counting process (see DIS, page 184). This is usu 
the opportunity cost of capital. 


3. Compute the benefit-cost ratio. 
BCR = PW, / PW, 
where PWs is present worth of gross incremental 
benefits and PW, is present worth of gross 
incremental costs. 


4. Apply the benefit-cost ratio as a criterion for proj 
evaluation according to the following rules: 
a) If the benefit-cost ratio is greater than or equal 
1.0, consider the project for funding. 
b) If the benefit-cost ratio is less than 1.0, 
project should not be funded 


then t 


6. Apply the benefit-cost ratio as a criterion for selecti 
projects by rank-ordering the projects according tod 
creasing benefit-costratios. 


EXAMPLES 


The projected cash flows of a project to purchase 
small tractor were presented in figure 2 of Cash Flow An; 
ysis (CFA, page 180). The benefit-cost ratio dezesmin. 


FIGURE 1 
Com puting the Benefit-Cost Ratio for Small Farmer Tractor Urilization—Purchase Option 


PRESENT WORTH PRESENT WORTH 
GROSS INCREMENTAL COSTS | ;; OF GROSS GROSS OF GROSS 
Discount | INCREMENTAL INCREMENTAL] INCREMENTAL 
nvestment Other Gross factor BENEFITS BENEFITS 
at 15% 


BCR = Present Worth of Gross Incremental Benefits/Present Worth of Gross Incremental Costs = ™1002/ 838 =1.2 
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from gross incremental benefits and costs discounted at 
15% is 1.2 (see figure 1). This simply means that the deci- 
sion to purchase the tractor is financially sound: the ex- 
pected benefits will outweigh the expected costs for the 
life of the tractor. 

The small farmer has another option: he may form a 
tractor cooperative. The cooperative would pool the mem- 
bers’ resources (or credit) to purchase a larger tractor. 
Each farmer would pay only the initial charter fee and an 
annual membership fee. Because the tractor’s time is to be 
shared, the projected gross benefits for each farmer would 
be less than if he had purchased his own (smaller) tractor. 

A cash flow analysis for the individual cooperative 


member reveals an annual cash flow of W125 after an ini-. 


tial cash outflow of {25 at the end of the first year (see 
figure 2). The net present worth for the project is W196 at 
2 discount rate of 15%. The benefit-cost ratio is 1.5 (see 
figure 3). This latter measure treats charter membership in 
the cooperative as an investment. A similar financial analy- 
sis could be conducted from the cooperative’s point of 
view. 

The benefit-cost ratio may be computed from an econ- 
omic analysis of the tractor utilization options. This in- 
volves a more sophisticated assessment of costs and bene- 
fits (see CFA, page 177), including shadow prices for labor 
and other inputs, and the sales for increased production 
(see, forexample, Gittinger, 1973). 

These examples are continued in Internal Rate of Re 
turn (IRR, page 200). The comparison between projects 
using the benefit-cost ratio is discussed in Cost-Benefit 


Analysis (CBA, page 212). 


BENEFIT-COST RATIO , 


THEORY 
The analytical formula for the benefit-cost ratio i 


ZS aB;/ [1 + (r/100)] 


z aC; | [1 + (r/100)]é 

iz 

where 
n = the number of years of the project 
OB; = the gross incremental benefits for ye 
SC; =the gross incremental costs for year 
r = discount rate (%) 


Each parameter of the formula represents an est 
by the project analyst. The estimated costs and be 
grow more uncertain as the number of years from the 
ent increases. However, the discounting process gives 
weight to the early project benefits and costs. As wit 
present worth (NPW, page 188), care must be excerci 


establishing the appropriate discount rate. 
The relation of benefit-cost ratio to other projec 


teria is discussed further in Cost-Benefit Analysis (( 


page 212). 
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Internal Rate of Return 


PREREQUISITE TOOLS 


Cash Flow Analysis (CFA, page 177), Discounting 
(DIS, page 184), and Net Present Worth (NPW, page 188). 


USAGE 


PURPOSE 


The internal rate of return (IRR) is a criterion for ana- 
lyzing projects based on the percentage return on invest- 


ment. 


USES 

1) The IRR is used as a 
nancial (and economic) advantages of a single project. 

2) The IRR is used to rank projects according to the 
most efficient utilization of resources (see Cost-Benefit 


Analysis, CBA, page 212). 


criterion for evaluating the fi- 


KEY DEFINITIONS 


1) The internal financial retu 
of return derived from a financi 
j.e., from the viewpoint 0 


rn of a project is the rate 
al analysis of the project 
f the individual, en- 


cash flows, 
terprise, or group. 

2) The internal economicr 
of return derived from an econom 
fits and costs to the society or economy © 


eturn of a project is the rate 
ic analysis of the bene- 
f the country. 


SHORT DESCRIPTION 


IRR is one of three widely used criteria for evaluating 
the financial and economic viability of projects. Like net 
present worth (NPW, page 188), IRR is computed from 
the present worth of gross incremental benefits and costs. 
Unlike net present worth, IRR does not indicate the pres- 
ent worth of the net incremental benefit, i.e., the equiva- 
lent present amount of all future project benefits. Rather, 
the IRR is an efficiency measure, reflecting the payoff of 
the project in terms of the precent return on outlays. In 


this regard, it is similar to the benefit-cost ratio (BCR, page 


194). 
A project’s IRR is the discount rate at which the 


present worth of the net incremental benefits is exactly 
zero. Since this cannot be solved analytically, it must be 
determined by interpolation. 

The IRR is compared to opportunity costs to deter- 
mine if the amount of return on investment is sufficiently 
high to justify the project. The difference between inter- 
nal financial return and internal economic return is not 
only in the assessment of costs and benefits, but in decid- 
ing whether the return is sufficient for the individual or for 


the society, respectively. 


ADVANTAGES 
The IRR may be computed without specifying the dis- 
count rate which corresponds to the opportunity cost of 


capital. Net present worth and benefit-cost ratio require 


this specification. 
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The IRR is the preferred criterion for ranking projects 
when total funds are limited (Gittinger, 1972). 


LIMITATIONS 

The IRR cannot be determined if the annual cash flows 
for a project are always positive (or zero). There must be at 
least one negative yearly cash flow so that the discounted 
benefits are equal to the discounted costs. 

The computation of the IRR may yield more than one 
discount rate which gives a zero net present worth. This 
usually occurs if there are large negative cash flows late in 
the project. However, most development projects start 
with an initially negative cash flow followed by a rising 
stream of benefits from which a single IRR may be com- 


puted. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

Determining the IRR is more difficult than computing 
ne: present worth or benefit-cost ratio. There is no analyti- 
cal solution for the IRR (except for uniform cash flows), 
and a trial and esror process must be followed. The bulk 
of the effort is in assembling the necessary data for anal- 
ysis {see Impact-Incidence Matrix, IPX, page 207). 


SKILL LEVEL 

Since computing the IRR is not a straightforward pro- 
cess, the analyst must be skilled, particularly in inter- 
preting cash flow patterns (see Cash Flow Analysis, CFA, 


page 177). 


TIME REQUIRED 

Ccmputing the IRR may take significantly Jonger than 
computing net present worth or benefit-cost ratio, but the 
overall process is primarily constrained by the availability 
of the appropriate data on cash flows. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 
A complete analysis of the costs and benefits over the 
life cf the project is required ‘see Cash Flow Analysis, 


Lis 
CF Ac pagel77). 

A criterion level for selecting or rejecting the project 
must be specified. preferably in advance. This level may be 


the Cpportunity cost of capital or the minimum rate of re- 
a a 
a wnich a funding eceacy will accept on the project. 


bo 


os 


INTERNAL RATE OF RETURN / 


TOOL OUTPUT 

The technique gives a single measure, the percent, 
turn on investment, which may be used as a criterio; 
funding or for ranking projects for funding. The IR 
compared to the specific criterion level, e.g., 15% r 
mum rate of return. If the IRR is larger, the proje 
recommended for funding. When ranking projects, t 
with the largest IRR should be funded first. 


IMPORTANT ASS UMPTIONS 

IRR assumes that one discount rate will apply dv 
the life of the project. This is not necessarily a limitin 
sumption, but it does make the measure less flexible 
net present worth (see Fleisher, 1972). 


METHOD OF USE 


GENERAL PROCEDURE 

Computing the IRR for a project is basically a trial 
error process which starts with a trial discount rate 
uses the procedure for computing the net present wo 
New discount rates are selected until one gives a zero 


present worth. 


1. Determine the incremental benefits and costs for 
life of the project. 
This is essentially the procedure found in Cash F| 
Analysis (see CFA, page 177). The net benefit fore 
year of the project is determined from estimates 
“with” and “without”’ project benefits and costs. 


2. Estimate the discount rate for the first trial com 
tation. | 
Select the discount rate by examining the cash fl 
pattern rather than by using the opportunity cost 
capital. If the project involves large negative cash flc 
followed by a delay in benefits, then the IRR is re 
tively low (choose a trial discount rate in the 10% 
20% range). If the project has immediate positive c: 
flows (benefits are not delayed more than a year 
two), then the IRR may be very high (choose a tr 
discount rate of 50% or more). If the cash flows fort 
project are never negative in any year of the proje: 
then the IRR is infinite and cannot be used. h 
present worth or benefit-cost ratio may be substitute 


3. Compute the net present worth of the project for th 


trial discount rate. * 
Designate this value as NPWy. If NP'W is zero, then th 


—_—_——-_ 


“ry = the trial discount rate. 


| FIGURE 1 
Flowchart of Interpolation Procedure to Determine Internal Rate of Return 


Select trial r 


Determine NPV 


Decrease rby 


Sor 10% 


Determine 
new NPV 


NEGATIVE 


What 
is the sign 
of NPV? 


IRR =rrialr 


Increase r by 
5 or 10% 


Determine 
new NPV 


POSITIVE 


NEGATIVE POSITIVE 


What 
is the sign 
of NPV? 


ZERO 


POSITIVE NEGATIVE 


Sum absolute values 
of NPV and previously 
computed NPV 


Divide NPV which 
is positive by sum 
(from previous step) 


Compute difference between 
trial rand previous trial r 


Process 


Multiply difference times 
quotient computed in step 
two steps previously 


ABBREVIATIONS 


IRR: internal rate 


of return 


Add this product to the 


. ent value 
NPV: net pres lower of the rwo discount rates 


r: discount rate 


Sequence of Steps 
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FIGURE 2 
The Annual and Total Cash Flows for the Smal] Farmer Tractor Utilization Options 


OPTIONS ) 


Net Incremental 
Benefits 
(Cash Flow)* 


a 
: 


1 
2 
S 
4 
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6 
a 
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9 
0 


— 


TOTAL 
CASH FLOW 


“In Unis (W), Temasek National Currency 


trial discount rate is the IRR. The first selected dis- 
count rate is unlikely to give azero present worth, and 
the process must be repeated. 


Select a new trial discount rate, rp. 
If the NPW, is less than zero, select a discount rate 


smaller than r}. How much smaller depends on how 
much NPW, isless than zero. Generally, select r2 equal 
to 10% less than r;. If NPW, is Positive, then select a 
larger trial discount rate. 


Recompute the net present worth using the trial dis- 


count rate r2. 
Designate this discount rate as NPW>. 


Select tia! discount rates and compute net present 
worths until reaching both a Positive and a negative 
present worth. 

Increase the discount rate if the net present worth is 
sill positive, and decrease the trial discount rate if the 
discount rate is negative. 


- Estimate the IRR by interpolation: 


Net Incremental 


Net Incremental 
Benefits 


Benefits 
(Cash Flow)* 


(Cash Flow)* 


where 
Tr, = lower discount rate 
4S, = difference between discount rates 
Nr = net present worth for lower discount same 
Ny = net present worth for higher discount rate 


Note: The lower and higher discount rates must prod 
net present worths of opposite signs. 


For example the lower discount rate (ry) is 8% witl 
net present worth (Ny ) of $100. The higher discount r: 
is 107 with a net present worth (Nj) of - $50. The sum 
absolute values of the net present worths is $150. The: 
fore, 

IRR = 8% + [10% — 8% ($100/$150)] 
= 8% + [2% (.67)] 
8% + 1.34% 
= 9.34% 
To reach a net present worth of zero, the IRR must | 
9.34%. 


This may be reduced to a simple procedure where th 
early years have a large negative cash flow and the lat 
years have cash flows thatare all positive. The flowcharti 
figure 1 may be used if the analyst is aware of the possibi 
ity that the multiple solutions to the IRR may exist (se 
Decision Tables, DTB, page 113), 


FIGURE 3 
Computation of the Internal Rate of Return for the Small Farmer Tractor Options 


Algorithms for Net Present Worth 


Purchase Option: 
NPW[r%/ 10] = 120 ADF[r%/10} - 500 DF[16/1] 


Rental Option: 
NPW [170/10] = 20 ADF [r%/10] 


Cooperative Option: es 
NPW [r7/10] = 65 ADF[r%/10] - 150 DF [r%/1] 


Internal Rate of Return Computations: 
Option 1: Tractor Purchase 


Jo 120 JADF[r%/10}} -500 |{DFR[r%/1]] = |NPW[r0/10] 


15 5.02 0.869 167.9 
20 4.19 0.833 86.3 
7 25 3.57 0.800 | 28.4 
| 
| 30 3.09 0.769 {1 -13.7 
J | 
| | 
i - mee eee es ee ee ee oe ee ee Se pom | 
INTERPOLATION: 28.4 + 13.7 = 42.1 
{ (see figure 2) ' 28.4/42.1 = 0.675 
| 30-25=5 
{ 5 X 0.675 = 3.4 
| cw cin' ses oss sin ee 94 = 28.4 or 28% 18 


Option 2: Tractor Rental | 
IRR cannot be computed since the cash flow is always positive (see figure 2). } 


(Figure 3 Continued) 
Option 3: Tractor Cooperative 


3.091 
2.414 
1.965 
1.421 
1.246 


INTERPOLATION: 4.2+2.3=6.5 


4.2/6.5 = 0.646 
80-70=10 
10 X 0.646 = 6 


65 JADF [r%/10}} - 150 = 
30 
40 
50 
70 
80 


INTErXAL RATE OF RETURN 


0.769 86.6 
0.714 49.8 
0.667 2h:7 
0.588 4.2 
0.555 -2.3 


70+ 6 = 76 or 76%1RR 


EXAMPLE 

Three options for small farmer tractor utilization have 
been presented in the prerequisite tools. The options and 
Net annual cash flows are shown in figure 2. The bene- 
fit-cost ratio and net present worth for each option were 
calculated using a discount rate of 15% for the Oppor- 
tunity cost of capital. 

The IRRs were calculated (figure 3); the procedure is 
given in the flowchart (figure 1). To simplify the repeti- 
tive calculation, an algorithm was developed (see Dis- 
counting, DIS, page 184), 

If the farmer purchases the tractor, the estimated IRR 
is 28%. This is low for an agricultural project, but is well 
above the estimated rate of return from alternative invest- 
ments, e.g., the 15% discount rate. 

If the farmer joins a tractor cooperative, the IRR is 
76%, which is more than double the IRR for purchasing. 
This indicates that joining the cooperative is the most eff 
cientuse of the farmers’ limited resources. 

The option of tractor rental hasan infinite IRR. It can- 
not be calculated because the annual cash flow is always 
positive. This happens quite often in the financial analysis 
of agricultural projects where there is little or no capital 
inves=nent 

Even though the IRR for the tractor cooperative is 
mostefficient, further analysis is necessary before this al- 
ternative is recommended. 

The computed IRRs represent the internal financial re- 
turn of the project. In order to compute the internal eco- 
nomic return of the project, a similar procedure must be 


followed. However, t=+ valuation of costs and benef} 
be for the target g-cuz> of farmers as a whole, an 
prices will be adjusted shadow-priced) to reflect mo 
curately the impact c= the nation’s economy. Be 
economic analysis is z =ore comprehensive and time 
suming process, and bezause many more assumptior 
necessary, this task zsauires skills in Macro-econc 
(see, for example, UNIDO, 1972). 


THEORY 


The internal rate ci return is the discount rate 1 
which the net preser: worth is zero. It is given by sol 
the following equatic= <or r*: 


zm (OB; — =C;)/ [1+ (r*/100)}i = 0 


m = number of rears of the project 
4B; = gross incremental benefits for yeari 
SC; = gross incremental costs for year i 
m, #* intetnal re-e of return (%) 


The formula canne: be solved analytically unless t 
pattern of benefits ==- costs are uniform. Otherwise 
trial and error approz=> ‘as described in the procedure 
necessary. 

Considerable debz:+ has addressed the practicality 
the IRR as a cnterio- ior project evaluation. Certain HE 
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terns of benefits and costs (in particular, a large cost near 
the end of a project) may result in more chan one solution 
to equation [2]. Gittinger (1972) answers the critics by 
claiming that the multiple solution problem is not likely to 
occur for cash flows typical of development projects. 

IRR is a widely used criterion for analyzing the finan- 
cial and economic soundness of development projects. It 
has been adopted as the principal measure for project ap- 
praisal by the US Agency for International Development 
(USAID, Handbook 3). The distinction between internal 
financial return and internal economic return underlines 
the importance of both financial and economic analysis 
for project evaluation (Gittinger, 1972). 
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Impact -Incidence Matrix 


PREREQUISITE TOOLS 
Benefit-Cost Ratio, BCR, page 194, 


USAGE 
PURPOSE 


An impact-incidence matrix tabulates the distributions 
of project costs and benefits to the affected groups in the 


society. 


USES 

An impact-incidence matrix is used to: 

1) Provide a decision maker with detailed information 
on the distribution of costs and benefits of a project or 
alternative projects. 

2) Identify the relative gain or loss for various groups 


__ affected by the project. 


3) Break down the benefit and cos: data by type of 
measurement and accuracy. 
4) Present measures of effectiveness and other non- 


monetary project impacts in conjunction with costs and 


income data, 
5) Permit decision makers to examine the inequities in 


Project design with regard to the distribution of benefits 


zandcosts. 


SHORT DESCRIPTION 


An impact-incidence matrix identifies the varjo 
groups affected either directly or indirectly by a proje: 
and the cost and benefit measurements by type (see figu 
1). The incidence of non-monetary project impacts is al 
tabulated, including strictly qualitative factors. 

With the matrix, the decision maker has an expande 
view of the attributes of the decision with regard to poss 
ble inequities in distribution. Benefit-cost ratios (BCF 
page 194), are presented not only for the project as 
whole, but for the affected groups (e.g., differentincom 


groups). 


ADVANTAGES 


1) In contrast to a single economic measure of project 
merit, the impact-incidence matrix requires the decision 
maker and the analyst to expand their assessment of a 
project to its distributional and qualitative impacts. 

2) The disparities in impact-incidence among various 
groups are identified. 

3) The type of measurement and the accuracy of the 
information is identified (e.g., an indirectly measured cost 
measurement is likely to be more subjective than a direct 
Project cost estimate), 
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y2cace a summary of the data in the matrix. 

- igen tify those groups that would gain significantly 

- lose disproportionately as a result of the project. 

- Discuss the significance of the individual and ag- 

=egated benefit-cost ratios. 

: Clarify the assumptions about multiplier effects or 
cther indirect consequences of the project. 

* Relate non-monetary ;measuresiand qualitative 
“mpacts to the affected groups and the! project. 


Le) 


foe 
’ 


Cos 


A. trciect to assist farmers with the purchase of small 
actors was started without giving full consideration to 


se iasmers’ difficulties in learning to use, operate, and 
miinitiit wactors. It was initially assumed that the tractor 
manutsctcrers would provide a brief training course; but 
wien iis was found to be inadequate, the manufacturers 
bax2¢ et providing a more extensive effort. The Ministry 
oz Asciculmure proposed to give this task to the Temasek 
University to be supervised by the Ministry’s farm exten- 


Soa) As) University costs were to Be met with a donor 
excv loan, making the cost to the farmers nominal. 

An impact-incidence matrix was prepared for the proj- 
ect to specify the costs vs. the benefits for the various 
gsoups wich would be affected (see figure 2). Each entry 
in the matrix implied a set of assumptions about the train- 
ing program and the impact of increased tractor utilization 
é azricultural system. 

A causs! sequence of interaction was assumed: 

Better utilization of tractors leads to greater accep- 
tance of mechanization and increased production, which 
leads to more demand for production inputs and de- 
creased demand for unskilled labor leading to higher un- 
employment for the landless except as balanced by higher 
volume of production, etc. This was the most likely 
scenario for the causal interactions in the system {see Oval 


2». iG 


Diagramming, OVD, page 81). 

The analyst assigned values to the quantified impacts. 
A benefitxost ratio was computed for the directly and in- 
Girectly estimated costs and benefits for each group. The 
quantitiable benefits outweighed the costs for all groups 
except the landless. 

Consequently, the Ministry of Agriculture modified 
the maining program to permit landless laborers to take 
ert in the course, supported in part by a special tax on all 
‘actor owners holding land in excess of 20 hectares. 


E> or 


IMPACT-INCIDENCE MATRIX 


THEORY 


Cost-benefit analysis has produced an extensiy 
ture which seeks either to rationalize or to discred; 


as a decision-making tool (see, for example, | 


1972). 
Weighing the benefits against the costs of acc 


action makes intuitive sense. However, there is littl, 
ment on how or whether to attempt the task at all, 
Maximizing the public welfare is no easy task: d 
what is in the public welfare is the first stumbling 
The impact-incidence matrix addresses the problen 
distribution of the benefits, costs, and other imp 
projects (Lichfield, 1966; Elliot and Picard, 197( 
impact-incidence breakdown is useful because of t 
taposition of non-monetary measures of effect 
with distributional projections of costs and benefi. 
decision maker is presented with a disagpregation o 
fits and costs according to the groups in society wh 
to gain or lose by the project (DeNeufville and St: 
1971). While this counters a major criticism of 
benefit analysis (de V. Graff, 1975) the problem s 
mains of identification and measurement of the inc: 


and impact of the project. 
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Cost-Benefit Analysis 


PREREQUISITE TOOLS 


Cash Flow Analysis, (CFA, page 177); Discounting, 
(DIS, page 184); Net Present Worth (NPW, page 188); Ben- 
efit-Cost Ratio (BCR, page 194); Internal Rate of Return 
(IRR, page 200); Impact-Incidence Matrix (IPX, page 
207). 


US AGE 
PURPOSE 


Cost-benefit analysis identifies, assesses, and weighs 


costs vs. benefits to evaluate the financial and economic 


merits of development projects. 


USES 

Cost-benefit analysis is used to: 

1) Provide a comprehensive analysis of costs and bene- 
fits including secondary, indirect, intangible, and societal 


benefits and costs of a proposed project or program. = 
2) Provide measures for deciding whether a project is 


financially viable and, in the process of analysis, to raise 
questions for consideration in redesign or implementa 


tion. art 
3) Rank projects for funding priority. 


4) Decide among alternative policies, strategies, or 
components of a single program, e.g., for Planning, Pro 
gramming, and Budgeting (PPB, page 236). 


SHORT DESCRIPTION 


Cost-benefit analysis is a generic term covering a range 
of theoretical issues and practical techniques. Because 
cost-benefit analysis has practitioners in many disciplines, 
a universal approach has not evolved. This description 
presents the systems engineering approach which views 
cost-benefit analysis as a multi-stage process leading to a 
comprehensive picture of project benefits vs. costs (Bord- 
man, 1973; DeNeufville and Stafford, 1971). 

A systems approach using cost-benefit analysis begins 
by specifying objectives, generating technically feasible al- 
ternatives, and then evaluating their economic and social 
consequences. Techniques for determining evaluation cri- 
teria are listed as prerequisites. Cost-benefit analysis is a 
synthesis of these techniques as well as techniques for 
identifying objectives, generating alternatives, and gath- 
eringcost-benefit data. 

Project costs are both direct (e.g., equipment, labor, 
management, physical resources) and indirect (e.g., dis- 


.placed workers, pollution, added infrastructure require 


ments). Similarly, the benefits may be both direct (e.g., 
increased production, reduced transport costs, increased 


earning power, better health) and indirect (e.g., employ- 
ment generation, support of local service enterprises, up- 
graded manpower). Some costs and benefits may be intan- 
gible (e.g., goodwill, improved morale, aesthetics), but are 
included in the presentation to decision makers (sce Im- 
pact-Incidence Matrix, IPX, page 207). 

Costs and benefits are identified and valued from three 
viewpoints: 

1) The individual project entity (private or financial 


‘ 


analysis). 
2) The economic system (public or economic analysis, 


see Gittinger, 1972). 

3) The socio-politicaleconomic system (social cost- 
benefit analysis). 

The second differs from the first in that market prices 
are adjusted to true equilibrium values using shadow prices 
or “‘accounting prices” (Little and Mirlees, 1974) (see 
Cash Flow Analysis, CFA, page 177). Social cost-benefit 
analysis is the more controversial approach of using “‘con- 
version factors” to weight cost-benefit estimates (Squire 
and van der Tak, 1975). Subjectively estimated factors 
incorporate social-political goals into the analysis, e.g., 
equitable distribution of project benefits favoring employ- 
ment generation, or promoting independence from for- 


eign goods. 


ADVANTAGES 

1) Cost-benefit analysis rationalizes the decision- 
making process to make the best allocation of scarce devel- 
Ofment resources. Attention is focused on the direct and 
indirect project impacts. Factors other than cost may 


enter into the computation and evaluation. Unintended - 


side effects (indirect costs) and unequal distribution of 
beneSts can often be pinpointed. 

2} Socially desirable objectives may be explicitly 
treatec as part of the evaluation criteria. 

3} A common measurement dimension (monetary 
units) permits comparing alternatives. 


—s 


LIMITATIONS 


i; Many social costs and bene‘its cannot be quantified 
cr accurately measured, e.g., the value of educational pro- 
grams or the benefits of increased health, security, or aes- 
hetics. Quantiative factors receive disproportionate em- 
phass simply because they are mezsurable. Cost-effective 
ss analysis partly addresses this problem (see CEA, page 


bedi”: Ben ahs ; 
2; Selecting projects using the benefit-cost ratio (BCR, 


COST-BENEFIT ANALYSIS | 


tribute little to achieving development objectiv 


Cost-Effectiveness Analysis, CEA, page 219). 
3) If a project is of sufficiently large-sca 


increased production or other project outputs will} 
impact on prices. Consequently, “no ‘partial’ mea 
project worth is appropriate and much more ela 
analytical procedures must be called into play” (Git 


1972, page 91). 


4) Conversion factors for social-cost-benefit a 
are subjectively estimated value judgments. Conflict 
ues clouds the subsequent cost-benefit analysis (St 


1975). 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

An overall analysis of the project is necessary in 
to be aware of its social and economic effects, as wel 
direct and indirect costs and benefits. An appropriat 
measure must be developed to evaluate each vai 
However, value data are often not readily availabl 
phisticated models may be necessary in order to cal 
values for social variables (see Squire and van de: 
1975). The level of effort will vary with the numl 
project alternatives and variables being considers 
short, cost-benefit analysis is a difficult and dema 


task. 


SKILL LEVEL 
Considerable skill and judgment are required to 

tify cost and benefit components, to estimate the ch 
over the life of the project, and to adjust the values 

shadow prices or conversion factors. The latteris ap 
ularly thorny task because of the difficulty, if no 
impossibility, of getting the “right”? shadow prices. 1 
ing in economic analysis and financial accounting ise 


tial, 


TIME REQUIRED . 

Cost-benefit analysis is a time-consuming exe: 
particularly when cost and benefit data must be gatl 
by interview or survey (see SVY, page 36). Careful an: 
and weighing of alternatives may take from several da 
several weeks. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


A formal cost-benefit analysis begins after project 
have been defined and the alternative programs to 1 
those goals are specified ‘see Objectives Trees, OBT, 
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49, and Morphological Analysis, MPA, page 10). In order 
to identify the social and economic components of both 
costs and benefits, a careful analysis of the project and its 
environment is essential (see Oval Diagramming, OVD, 
page 81). A systems viewpoint is recommended (see Sys- 
tem Definition Matrix, SDM, page 67). 


TOOL OUTPUT 


A proper cost-benefit analysis presents recommenda- 
tions to funding sources and decision makers, including: 


1) The financial and economic merits of each project 
relative to minimum acceptable returns on the resources 
invested. 

2) A rank-ordering of alternatives according to de- 
creasing benefit-cost ratios or decreasing internal rates of 
return. 

3) Aconcise statement of the assumptions inherent in 
the analysis and, where possible, the sensitivity of eco 
nomic criteria to changes in assumptions and analytical 
parameters. 

4) A discussion of intangible factors related to both 
economic and non-economic criteria. 


IMPORTANT ASSUMPTIONS 


All relevant project benefits and cosis are identifiable 
before the project is implemented. Benefits and costs 
occurring at different times during the project may be val- 
ued at their present worths by assuming a discount rate. 
The discounting process reflects the time-preference for 
money, i.e., the opportunity costs associated with com- 
mitting resources to the project and foregoing other in- 
vestment alternatives (see Discounting, DIS, page 184). 

Itis usually assumed that inflation will affect all project 
alternatives equally and thus is ignored in projecting fu- 
ture cash flows. However, if inflation rates can be accur- 
ately estimated for each year of the project, the differen- 
tial impact on both costs and benefits may be incorpor- 
ated in the cash flow estimates. * 


Weighing costs against projected benefits assumes that 


anet benefit accrues to society, Le., that the project recipi- 


ents may realize anet benefit which does not cause a nega- 
tive benefit to some other segment of society (Sirken, 
n.d.). A comprehensive analysis of indirect costs and BEY 
fits theoretically reveals such anomalies, but this degree o 


thoroughness is not always feasible. 


c Analysis in Developing 
(January-March 1972): 27-35. 


*G.A, Fleischer, ‘Engineering Economi 
Countries,’ Technos 


METHOD OF USE 


GENERAL PROCEDURE 


As there are numerous texts devoted exclusively to the 
subtleties of cost-benefit analysis, the following steps 
sketch the process in the broadest sense. 


1. Identify the cost and benefit components expected to 
result from project implementation. 

1.1 Identify those groups directly and indirectly af- 
fected by the project (see Impact-Incidence Ma- 
trix, IPX, page 207). 

1.2 Identify and estimate all benefits and costs pro 

“fected for the life of the project (see Cash Flow 
Analysis, CFA, page 177). 

1.3 Summarize all assumptions of incremental costs 
and benefits in a clear format for examination by 
decision makers. 


tO 


. Determine the present worth of all fucure costs and 
benefits. 
2.1 Discount the cash flows to the present using the 
appropriate discount rate (see Discounting, DIS, 
page 184). 
2.2 Compute the net present worth of the project cash 
flow (see Net Present Worth, NPW, page 188). 


3. Determine the efficiency measures of project perfor- 
mance. 
3.1 Compute the benefit-cost ratio (see BCR, page 
194). 
3.2 Compute the internal rate of return (IRR, page 
200). 


4. Consider a project for funding if: 

4.1 The net present worth is zero or positive where net 
present worth is computed at a discount rate equal 
to the opportunity cost of capital 
The benefit-cost ratio is 1.0 or greater (using bene- 
fits and costs which have been discounted at arate 
equal to the opportunity cost of capital). 

4.3 The internal rate of return is not less than a mini- 
mum acceptable rate of return, ie., the opportu- 
nity cost of capital (usually specified at 15% or 
higher). 


4.2 


5. Rank alternative projects or components of a project. 
5.1 Rank the alternatives in order of descending inter- 
nal rate of return or benefit-cost ratio measures, 
unless the alternatives are mutually exclusive. 
5.2 If the alternatives are mutually exclusive, select 
the one with the largest net present worth. 


6. Repeat steps 2 through 4 for each group directly 
affected by the project (see Impact-Incidence Matrix, 


IPX, page 207). 


7. Contrast the financial analysis of the project with the 
economic analysis by separately computing costs and 
benefits from the viewpoint of the national economy.* 
7.1 Determine the costs and benefits for all directly 

and indirectly affected groups. 


7.2 Estimate the shadow prices for the factors of pro- 
duction. 

7.3 Estimate shadow prices for foreign exchange. 

7.4 Estimate shadow prices for government price sup- 
portedcommodities. 

7.5 Determine conversion factors for societal goals 
(Optional), e.g., weighting benefits by income 
groups, favoring employment generating projects, 
promoting independence from foreign goods (see 
UNIDO, 1972, and Squire and van der Tak, 
1975). 

7.6 Compute the criteria net present worth, benefit- 
cost ration, and internal rate of return using the 


adjusted cash flows. 


8. Complete the analysis with a consideration of non- 
monetary impacts of the project. 

8.1 Impacts which may be quantified (but not in mon- 
etary units) should be listed (see Impact-Incidence 
Matrix, IPX, page 207). 

&.2 Impacts which may be qualitatively estimated 
should be presented alongside the quantitative 
data. The relevant impact, importance, or signifi- 
cance of the factors may be assessed to aid deci- 
sion makers (see Rating Scales, RTS, page 29, and 
Interaction Matrix Diagramming, IMD, page 92), 


EXAMPLE 


smal tractors by farmers having limited land-h oldings (less 


"These steps Tepresent theoretically complex tasks which cannot 
be covered in a short description. The reader js referred to the proj- 
ect evaluation literature. Sez, for example, Gittinger, 1972: Little 
ans ‘Miclees, 1974; Squire and van der Tzk, 1975; Hinrichs, 1969; 
SHU NID OO! 1972 

“"rnis example was stimulated by the report by Jchn Balis, ‘““Fhe 
Vilization cf Small Tractors in Integrated Agricultural Develop- 


ee ee ree ree 


msg. Sccnomics Scarf Paper No. 74-15 (Ithaca, N.Y.: Department 
iculturs!] Economica cornea University, June 1974), 
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target group and considered three alternative , 
which each farmer could acquire a tractor. Thes 
tives were: 

Option 1: Purchase a five horsepower walkin 

Option 2: Rent a tractor and services of an 

Option 3: Form a cooperative to share in the 
and maintenance of a 15 horsepower tractor.* 

Financial analysis of the options began by e: 
the projected cash flows: option (1) was analyze 
Flow Analysis (CFA, page 177); option (2) was 
in Net Present Worth (NPW, page 188); and optio 
analyzed in Benefit-Cost Ratio (BCR, page 154). 
flows for the three options were summarized in 
Rate of Return (IRR, page 200). A summary of 
tions which were necessary to contrast the “w 
“without” situations was prepared (see figure 1). 

Four measures of financial soundness were cc 
(see figure 2). Option (1) gives the largest total c; 
over the ten-year life of the project. Option (3) ¢ 
next largest cash flow. Alternative projects cc 
using the total cash flow criterion must have the sa 
ect life, ten years in this case. However, the time. 
money is not considered in cash flow com paris 
Discounting, DIS, page 184). 

Discounted measures, net present worth, bene 
ratio, and internal rate of return take into account 
streams of benefits and costs. A discount rate of 1 
selected to reflect the best return of money invest 
ternative projects. 

The net present worth criterion applied tothe th 
tions indicates that all are financially feasible. Si 
options are mutually exclusive (e.g., the farmer 
likely to rent and purchase a tractor simultaneous 
net present worth may be used to select the best F 
Option (3) has the highest net present worth follo 
option (1) (see figure 2). This simply means that 
farmer joins a tractor cooperative, the value of his 
earnings translated to the present is more than { 
other options, 

Benefit-cost ratio and internal rate of return m 
project efficiency, Ranking the options on the b: 
>enefit-cost ratio indicates that option (3) gives mor 
efits per unit of cost than option (2), and option ( 
the lowest ratio (see figure 2). The benefit-cost ratic 
ings may differ from the net present worth rankings 
there are differences in the relationships between 

enefits and operating costs for the two project 
Gittinger, 1972, page 65). 


“A fourth alternative isto continue current practices which: 
animal power. However, this alternative was treated in sy 
flow analysis by determining the incremental costs and ben 
the cifference between the “with project” and the “withou: 
ect’’ costs and benefits. 


FIGURE 1 
Summary of Assumptions for Small Farmer Tractor Utilization 


Projected Increases in Cost and Benefit Data and Percent Change (%A) 


WITH PROJECT’ 
WITHOUT | Option 1 Option 2 Option 3 
PROJECT | Purchase 


Rent Cooperative 


oe 1 CREE 


8 20% 20% 
Investment rh 


1 All costs and benefits are constant over the 10-year project life. 
2 Inflation affects all project costs equally. 
3 Additional costs of seeds and other inputs are compensated by reduced labor costs. 


Production Expenses” 


Usual expenses® 
Operation & maintenance 


4The charter fee for joining the cooperative is an investment in shared ownership of the tractor. 
5 The increased production is realized in the first year of the project. 


FIGURE 2 
Comparing the Small Farmer Tractor Utilization Options 


Total 
Cash Flow 


Option 1 Purchase 
Option 2 Rent 


Option 3 Cooperative 


Rank Order 
of Options* 


* According to criterion. 


comeeealine diea! ad . rn ~ 
ONS on se § ete dee tn OI St tae OO one 
oe, 
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Computing internal rate of return was not possible for 
a] options* (see Internal Rate of Return, IRR, page 200). 
The internal rate of return for tractor rental was indeter- 
minate. The third option has a significantly higher internal 
rate of return than option (1), and on this basis the farmer 
should join the cooperative rather than purchase his own 
tractor. However, since the projects were mutually exclu- 
sive, the internal rate of return would not normally be 
used for ranking, since it may give an erroneous ordering 
(see Gittinger, 1972). 

An internal rate of return of 28% for option (1) simply 
means that this investment would generate a return on 
capital which would be equivalent to acompound interest 
rate of 28% per annum. While this was nearly double the 
estimated opportunity cost of capital, 15%, it was not par- 
ticularly high for an agricultural project. The internal rate 
of return for option (3) is more representative of the re- 
turns to be expected. 

Computing the criteria illustrates the mechanics of 
cost-benefit analysis. In order to develop a single metric 
for judging the financial worthiness of projects, many as- 
sumptions tend to get further submerged in the manipula- 
tions of the data. 

The impact-incidence matrix presents nota single mea- 
sure such as net present worth, but rather a tabulation of 
individual metrics computed for various groups directly or 
indirectly affected by the project (see Impact-Incidence 
Matrix, IPX, page 207). Who benefits and who loses if the 
small farmer mechanizes those tasks which require human 
cr animal labor? Are all the benefits and costs quantifi- 
zble, let alone measurable, in monetary units? Answering 
these questions adds essential dimensions to cost-benefit 
analysis asa decision-making tool. 


‘Many examples of cost-benefit analysis may be found 
iz. the literature, although only in the past decade has its 


2>p cation in service fields such as family planning, educa- 
-o=., and health been documented. 

rie Gambia case study (Jones, 1972) presents an excel- 
-£=7 zeatment of the technical side of cost-benefit analysis 
22rd to rice production. Frianeza (1974) has a fairly 
ccrmrlete example of cost-benefit analysis applied to the 
-42: grape industry in the Phillipines. Bruce (1976) pre- 
uer.ts a case study of the application of conversion factors 
=< 17212] cost-benefit analysis along with a critique of the 


=: °7.R may only be calculated if the incremental costsexceed 
we: .cemental benefits at least once in the life of the project. 
-~t: 2+ cOnvention all costs are competed at vear-end, Option (2) 
i+ = Lesa negative cash flow. 


COST-BENEFIT ANALYSIS 


THEORY 


Cost-benefit analysis arose in the 1930s as ; 
evaluating water resource projects in the United: 
application to other fields grew, producing a 
critical comment (see, for example, Graaff, 1975, 
ville and Stafford, 1971; and Hines, 1962) and a] 
approaches (Little and Mirlees, 1974, and UNIDx 
The weakness of the cost-benefit approach and ; 
bution to decision making have been explored 
example, Hinrichs, 1969; Kendall, 1971; and 
1972). 

The work of Gittinger (1972) and the Econ: 
velopment Institute of the World Bank in deve 
comprehensive approach to the analysis of agr 
projects provided the basis for the techniques int 
tools. The problems of applying cost-benefit an 
other sectors have been reported (see Sirken, 1 
Divine, 1966), though much remains to be learn: 
valuing the benefits and the costs of social sen 
grams. 

Social cost-benefit analysis, which attempts 
cost-benefit factors to incorporate societal goals, 
plex process (Squire and van der Tak, 1975). T 
many problems with the added complexity and tl 
bility thet value judgments are hidden from | 
makers. Many argue that the best analysis presents 
array of evaluation criteria to the decision make: 
than attempting to produce a highly aggregate 
figure of project merit (Bruce, 1976, and Stewart 
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A 


Cost Effectiveness Analysis 


PREREQUISITE TOOLS 


None. 


USAGE 
PURPOSE 


Cost-effectiveness analysis evaluates the effectiveness 


‘relative to the costs of alternative systems. 


USES 


Cost-effectiveness analysis is used to: oe 

1) Evaluate alternative means for achieving specified 
ends, e.g., alternative components of a system or project 
design. 

2) Evaluate and compare alternative projects or sys- 
tems for the purpose of selecting the most cost-effective 
alternative. 

3) Analyze the trade-offs in varying the size, complex- 
ity, or scope of a design, €.g-, estimating the cost of in- 
creased effectiveness. 


KEY DEFINITIONS 


1) The effectiveness of a Project or system is the de- 
gree to which the project or system design objectives are 
achieved. 


2) Project efficiency is the ratio of project outputs | 
inputs, e.g., the production rate for a given resource uti 
zation rate. 

3) A system isa collection of components which inte 
act to achieve acommon function. 


SHORT DESCRIPTION 


Cost-effectiveness analysis is a crucial step in a system 
analysis strategy. After deciding on objectives, identifyin, 
alternative means to achieve the desired ends, and estab 
lishing criteria for evaluation, components are selecte< 
which maximize cost-effectiveness. Costs and effective. 
ness are central to the evaluation and design of systems or 
projects, 

The criteria are used in one of two ways to rank alterna- 


tives: 


1) By least-cost, considering only those alternatives 
which achieve the specified minimum level of effective- 
ness. 

2) By maximum effectiveness, in which all alternatives 
have been designed so as not to exceed a specified maxi- 
mum resource requirement. 


Cost-effectiveness analysis is similar to cost-benefit 
analysis (CBA, page 212) except that the non-monetary 
performance of the project is estimated. 


220 / ANALYZING PROJECTS 


ADVANTAGES 


1) Cost-effectiveness analysis ranks alternatives by a 
process which is accessible to critical examination, in con- 
trast to intuitive or committee decision-making processes. 
The technique provides a framework for systematic deci- 
sion making and “efficient employ ment of the knowledge, 
judgment, and intuition of available experts” (Quade, 
1968, page 32). 

2) While the benefits accruing from a project are often 
not measurable (particularly in monetary terms), indexes 
of effectiveness can always be developed from project goal 
statements. 

3) In contrast to project efficiency measures, e.g., the 
benefit-cost ratio (BCR, page 194) and the internal rate of 
return (IRR, page 200), cost-effectiveness analysis com- 
pares the relative achievement of goals. 

4) Because cost-effectiveness analysis is a carefully 
structured approach, the process leading to a decision may 
be retraced; and new knowledge or different subjective 
judgments can be used to update recommendations. 


LIMITATIONS 


The analyst must necessarily limit the scope of a cost- 
effectiveness study, which may lead to sub-optimization. 
The most cost-effective alternative may not be the best 
choice when the larger problem situation is considered. 

The complexity of the analysis increases significantly if 
more than one future situation (contingency) is examined 
(see Contingency Analysis, CGA, page 147). Conse- 
quently, analysts and decision makers tend to restrict the 
analysis to the most likely contingency. 

Projects with different objectives cannot be compared 
using cost-effectiveness analysis because the scales of ef- 
fectiveness will differ significantly. Cost-benefit analysis 
(see CBA, page 212), although limiting the choice to finan- 
cial or economic criteria, permits a comparison of these 
projects if benefits can be valued monetarily. 

Ranking projects can be inconclusive when more than 
one measure of effectiveness applies. Often, determining a 
suitable measure of effectiveness is difficult, if notimpos 
sible (e.g., evaluating goal achievement of social service 
programs). 

Cost-effectiveness 
performance, in contrast to cost- 
cludes benefits and costs accruing to other elements in the 
environment. This may not promote better decisions, but 
cost-benefit analysis alerts the decision maker to these is- 


focuses only on the system and its 
benefit analysis which in- 


sues. 

Cost-effectiveness anal 
among projects only if they are 
same ends. Otherwise, acommon 
cannot be identified for evaluating eac 


ysis may be used to choose 
alternative means to the 
measure of effectiveness 
h alternative. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

The major task in cost-effectiveness analysis is gather- 
ing information to measure effectiveness and cost. Once 
these data are obtained and transformed into quantitative 
measures, the analysis is essentially complete. 


SKILL LEVEL 


Considerable judgment must be applied to determine 
measures of effectiveness and to apply them in the analy- 
sis. This is never strictly a mechanical process of translat- 
ing goals into measures, although construction of a system 
model is desirable for analyzing performances of large 


complex systems (or projects). 


TIME REQUIRED 


A cost-effectiveness analysis may take several days if 
many projects are to be compared on more than one mea- 
sure of effectiveness. The actual time required depends 


primarily on the availability of appropriate information. 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 


1) Resource analysis is the “process of systematically 
determining the economic resource impact of alternative 
proposals for future courses of action’”’ (Fisher, 1968, page 
124). It includes not only estimating the direct costs, but 
measuring the drain on economic resources which could 
result if various alternatives were selected and imple- 
mented, e.g., diverting essential raw materials and skilled 
manpower to a project. 

2) Sensitivity analysis is a process of varying the esti- 
mated values of selected parameters in the design in order 
to determine the sensitivity of results to the uncertainty of 
the estimate. For example, the variation in total system 
cost is determined for selected values of key system speci- 
fications such as size, responsiveness, Or teliability. 


REQUIRED INPUTS 
The objectives must be established (see Objective 
Trees, OBT, page 49). Alternative means will have to be 


specified, e.g., various project approaches have been iden- 


tified. 


Cost data must be available to determine the cost for 


each alternative. 


ee ce ee 6 er ge 


or wow meme viene. 


TOOL OUTPUT 


fectiveness analysis presents a rank-ordering of 


Cost-e 
t select the 


alternatives to aid decision makers. It does no 
best alternative unless non-quantifiable variables such as 
the political, social, and cultural implications are to be ig- 
nored—an unlikely situation for development planning. 
Consequently, the results of the cost-effectiveness analysis 
represent one part of the total information desired for 
project selection. 

If project effectiveness is not identifiable as a single 
measure, the analysis may result in several rankings of ef- 
fectiveness vs. cost, all of which are presented to the deci- 


sion maker. 


IMPORTANT ASSUMPTIONS 

The results of a program or projectcan be evaluated us- 
ing a criterion which measures the achievement of objec- 
tives. The objectives are determinate, stationary, and sta- 
ble over the life of the project and consensual among the 
decision makers (see Objective Trees, OBT, page 49). Al- 
though these assumptions are not limiting, they should 
caution the decision maker and analyst against naively ap- 
plying a cost-effective criteria without considering their 


implications. 


METHOD OF USE 


GENERAL PROCEDURE 
1. Given the project or system goals, identify the measure 
of effectiveness. 
1.1 Translate each goal into measurable sub- objectives 
(see Objective Trees, OBT, page 49). 
1.2 Repeat 1.1 until quantifiable sub-objectives are 
identified. 
1.3 Select quantifiable objectives which characterize 
the effectiveness of the project/system. 
. Construct an effectiveness scale. 
2.1 Determine the units of measurement, e.g., passen- 
ger-miles per hour, extension contact hours per 


tv 


armer. 
2.2 If necessary, use a dimensionless index to compare 
subjective estimates of effectiveness. 
2.3 Identify the range of the effectiveness scale, typi 
cally 0 to 1 for an index (see Rating Scales, RTS, 


page 29). 
3. Give alternative meansand evaluate them effectiveness. 
3.1 When feasible, construct an analytical model to 
compute effectiveness estimates for each alterna- 
vive ‘see Computer Simulation Models, CSM, page 


ee 
TN 
120}. 
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3.2 When mathematical modeling is not feasible, e 
mate the effectiveness subjectively. Pooledexp 
judgments may be used (see Delphi, DLP, p; 
168), or empirical data may be obtained (either 


experiment or pilot study). 


4, Determine costs by making a resource analysis of 1 
alternatives. 

4.1 Determine a basis for costing which is compara 
across all alternatives. 

4.2 Identify direct costs, both initial and recurre 
and costs associated with making resources (e 
raw materials and manpower) available to the px 
ect (see Cash Flow Analysis, CFA, page 177). 

4.3 If the costs are distributed differently in time 
each alternative, discount all costs to determ 
the present worth (see Discounting, DIS, p 


184). 


5. Rank-order the alternatives. 
5.1 Compute the ratio of effectiveness to cost for e: 
alternative. 

5.2 Plot effectiveness vs. cost (optional). 

5.3 Determine the cut-off levels for considering al 
natives: 

a) If a minimum level of effectiveness is requir 
ignore all objectives which fall below this le 
If none exceed the level, either change 
specification or identify new alternatives. 

b) If a maximum level of cost is permitted, ign 
all alternatives which exceed this limit. If nc 
has acceptable costs, consider scaling down 
scope of the alternatives or identify less co: 
means. 

5.4 Rank-order the remaining alternatives using the 
tio of effectiveness to cost. If two or more alter 
tives have identical ratios, select the most effect 
or least costly depending on whether a) or 
holds.* 


6, Test the sensitivity of the rankings. 

6.1 Select a variable (cost or effectiveness) for wh 
the estimate is most certain. 

6.2 Using either the analytical model or an exp 
mental design, estimate how asmall change in: 
variable will affect the subsequent computati 

6.3 Repeat 6.2 for several values included in the lik 
range of the variable. 


* "C08 a : 
Specifying both a minimum level of effectiveness and a maxin 
acceptable cost may lead to an under-specification of the syst 
aes fa . " . 
The desisnet may fail to identify the most cost-effective alte 
tives. 


a? FIGURE 1 
Reliability and Acceptance Rates for Alternative Means of Birth Control 


Probability of Average Acceptance Rate 


Alternative Means Preventing Pregnancy for Specific Population Effectiveness 


Male contraceptives 


Female contraceptives: 
Hormonc pills 


Intrauterine devices 


Male stcrilization 


Female sterilization 


FIGURE 2 
Cost Analysis of Alternative Means of Birth Control 


Couple Year(s) Estimated Protection Cost 


Alternative Means of Protection Method Cost! Per Year 


Male contraceptive 0.0083/condom” 


Female contraceptive 


Oral 
Intrauterine 


0.0667/cycle? W 30/cycle 
3/1UD* Y 6v/1UD 


Female sterilization 


the national currency of Temasek. 

Assuming an average Use of 120 condoms pet year. 

Assuming 15 cycles are required cach year (including wastage). 

Assuming each [UD inserted is retained for an average 3 ycars. 

Assumving 10 years from avera to onset of menopause. 


Assuming same average age ) 


y = Unis = 


ge age of sterilization (35) 
f wife of the man sterilized. 
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FIGURE 3 


Cost-Effectiveness of Alternative Birt h Control Means 


a) Eflfectiveness-Cost Ratio 


“Effectiveness Ratio: 
uf Effectiveness to Cost 


Fae, 


Yearly Cost 


Alternative 


1. Male contraceptives 


Female contraceptives 


2, Oral 
% tty 


4. Male sterilization 


5. Female sterilization 
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EP PECTIVENESS 


b) Plot of Effectiveness vs. Cost 
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6.4 Present the sensitivity analysis results to the deci- 
sion maker as a range of variation in the effective- 
ness to cost ratio or as a box which indicates the 
uncertainty on the plot of effectiveness vs. costs. 


EXAMPLE 


The Temasek Family Planning Council proposed to ex- 
amine the cost-effectiveness of various means of birth con- 
trol in use in Temasek. The objective of the project was to 
determine the best means of birth control for funding. 
Two criteria were identified: the reliability of the particu- 
lar method and the percentage of the population accepting 
that method. The effectiveness was defined as the product 
of reliability and rate of acceptance (see figure 1). 

The next step was to analyze the costs of the alterna- 
tives. The measure adopted was the equivalent Couple 
Year of Protection for each technique (Edmonds, 1975). 
For example, data indicated that each couple used an aver- 
age of 120 condoms per year. Theneach condom afforded 
0.0083 CYP. Similarly, a sterilization operation would 
protect acouple for the remaining child bearing years. The 
corresponding CYP was computed by subtracting the aver- 
age age at sterilization from the average age for onset of 
menopause (see figure 2). 

The protection cost per year of each birth control tech- 
nique was computed by dividing the estimated method 
cost* by the CYP. On a cost basis alone, there were vast 
differences in the resources required to provide a year of 
protection by various alternatives. 

The costs were compared to the estimated effectiveness 
(see figure 3). Computing the ratio of effectiveness to cost 
revealed that an intrauterine device was by far the most 
cost-effective technique. However, the level of effective- 
ness was estimated at less than 50% (due to the low rate of 


acceptance). If 50% were taken as the minimum level of 


effectiveness, then only oral contraceptives and condoms 
would be considered. 

This analysis considered only the means of birth con- 
troL A cost-effectiveness analysis of a birth control pro- 
mately have to examine the effects of us- 
es on the birth rate vs. the infrastruc- 
liver the techniques. Unfortunately, 
such an analysis is complicated by 1) the delay in observ- 
able changes in birth rate and 2) the multitude of alterna- 
tive explanations for changes in birth rate. The problem in 
evaluating cost-effectiveness of these programs is de- 
scribed in Schultz (1972). In an earlier paper, Schultz 
(1967) formulated an economic model of family planning 


in order to measure benefits vs. costs. 


gram would ulti 
ing various techniqu 
ture necessary to de 


astructure required for delivering the 
ough this could be incorporated into each 
d component, a separate analysis of the 


“These costs ignore the infr 
various techniques. Alth 
method cost as an overhea 
means of delivery is more appro priate. 


THEORY 


Cost-effectiveness derives from cost-benefit analysis 
(Rowen, 1969). Defense Department analysts realized 
that valuing the benefits of weapon systems was not feas- 
ible and looked for other measures of system perfor- 
mance. The theoretical analysis of system models and tac- 
tical and strategic plans followed (Quade and Boucher, 
1968). The technique has been applied to policy planning 
and project design in fields like social services. The formid 
able task of valuing benefits is circumvented by using non- 
monetary effectiveness scales to compare alternatives. 

The role of resource analysis and sensitivity analysis in 
costeeffectiveness studies is presented by Quade and 
Boucher (1968). DeNeufville and Stafford (1971) address 
additional theoretical issues, such as determining the cpti- 
mum system effectiveness as a function of the cest. 

Krueckeberg and Silvers (1974) give an excellent de- 
scription of cost-effectiveness analysis applied to urban 
planning and the theoretical basis for selecting among al- 
ternative projects using the effectiveness-cost ratio. 
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IX 


Planning, Controlling, and 
Evaluating Projects 


Program Planning Method 
IDEALS Strategy 
Planning, Programming, and Budgeting 
Critical Path Method 
Gantt Charts | 
Logical Framework 


Several techniques have been selected which do not fall exclusively within any of the 
major purpose categories. Two (Program Planning Method and IDEALS Strategy) are com- 
prehensive approaches to project design and implementation. A formal system for planning 
and management (Planning, Programming, and Budgeting) is also described. 

Successful implementation and management of complex projects depend on careful at- 
tention to details in the planning stage. Diagramming the sequence of necessary activities 
(Critical Path Method) and scheduling according to available resources (Gantt Charts) assist 
this process. 

Evaluation of a development project must begin with design. The final technique (Logical 
Framework) is a test approach to planning, documenting, and evaluating projects. Attention 
is directed to the logical assumptions and verifiable indicators of project achievement. 

All these techniques are unified in their attention to planning for implementation, stress- 


ing systematic analysis, and emphasizing results. 
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Program Planning Method 


PREREQUISITE TOOLS 


Nominal Group Technique (NGT, page 14). 


USAGE 


PURPOSE 


Program Planning Method provides a comprehensive 


.. approach to: 


1) Identify and define problems. 
2) Specify program alternatives to solve the problem. 


3) Selectand detail programs. 


USES 

The Program Planning Mcthod is used to: 

1) Coordinate the best use of experts, decision makers, 
and client/citizens in the planning process. 

2) Plan programs in different fields, such as health, 
urban, and educational planning. | 

3) Develop consensus in group decision making when 
people from widely different backgrounds are involved. 

4) Legitimize decisions in the minds of the public in 


order to increase public acceptance of programs. 


SKORT DESCRIPTION 


Program Planning Method is a systematic and struc- 

‘ » tavaluing eli - 

tured planning strateg) involving clients or consumers, ex 
perts, and decision makers in group processes. The 


Nominal Group Technique (NGT, page 14) is used in 
three stages. First, a number of client-problems are 
identified and rank-ordered. Second, this list is used to 
generate possible solutions. Resources needed to imple- 
ment the solution are also listed. Third, the group arrives 


at the final program. 


ADVANTAGES 


The originators of the Program Planning Method 
strategy (Delbecq and Van de Ven, 1971) claim that it: 


1) Organizes client, consumer, or community partici- 
pation. 

2) Increases the legitimacy of the program in view of 
the recipients’ (clients/citizens) involvement. 

3) Decreases potential resistance to the implementa- 


tion of the program. 
4) Increases the program’s effectiveness because all 


concerned parties participate in the design. 

5) Facilitates proper problem identification and re- 
duces the chances of solving the wrong problem. 

6) Facilitates the use of outside experts in the planning 


process. 
7) Incorporates the advantages of the Nominal Group 


Technique (see NGT, page 14). 


LIMITATIONS 


1) The participation of consumer and client groups 
may be unfeasible either financially or logistically. 
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2) The role of the group leader is more important than 
in single applications of the Nominal Group Technique. 
The same leader is often in charge of three different groups 
and thus can control the success of the exercise. 

3) Client/citizen participation may have a negative ef- 
fect on the planning process, e.g., premature expectations 
may arise. 

4) The highly structured nature of the Program Plan- 
ning Method may stifle effective participation. (See Nom- 
inal Group Technique, NGT, page 15, for related 
limitations.) 


REQUIRED RESOURCES 


LEVEL OF EFFORT 

Members of client groups, experts, and other con- 
cerned people must be identified, and the group sessions 
must be arranged and conducted. This may pose problems 


of logistics and requires planning. 


SKILL LEVEL 

Considerable skill is required to direct the Program 
Planning Method. The group leader must be able to 1) 
understand and break down the planning process into a 
discrete series of workable phases; 2) identify and inte- 
grate the target reference groups in each phase; and 3) 
direct the groups so that they perform effectively. 


TIME REQUIRED 

The Program Planning Method requires three or more 
sessions of one-half day each. There may bea gap of afew 
days between the sessions. Lead time is needed for or- 


ganizing groups and meetings. 


SPECIAL REQUIREMENTS 


The Program Planning Method strategy requires: 

1) A meeting room where groups can cluster arounda 
table. 

2) Index cards to record the group members’ ideas and 
preferences. 

3) Flip charts with large sheets of paper, marking or 
felt pens, and tape. 


DESCRIPTION OF TOOL 


DEFINITIONS 


1) A solution component is the part of a program that 
is proposed as the solution, e.g.,a mobile medical unitina 


health care program. 
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2) Rank-ordering is the process of weighing one ite: 


. . “inten? O 
against others and then ordering the items by wetgatona 


scale such as importance or priority. 


REQUIRED INPUTS 


Program Planning Method requires a knowledge of: 

1) The problem area, e.g., urban renewal, health care 
delivery. 

2) The target area, e.g., a region, a community, or an 
ethnic group. 

The method also requires that user groups, experts, and 
decision makers participate. 


-__ 


TOOL OUTPUT 

1) A list of consumer orclient problems ordered to in- 
dicate priorities. 

2) Specification of the problem to be solved. 

3) Specification of the program designed to solve the 
problem. 


IMPORTANT ASSUMPTIONS 


Program Planning Method assumes that problem identi- 
fication is necessary before planning a program. The best 
qualified people to identify the problem are the groups af- 
fected by potential programs or current inadequate pro- 
grams. These people are brought together with planners 
and program personnel to identify problems and to rank 
them. 

Program Planning Method is also based on assumptions 
regarding change processes in organizations, and the best 
use of experts in the process (see Delbecq and Van de Ven, 


1971). 


METHOD OF USE 


GENERAL PROCEDURE* 


1. Organize the client group. 

1.1 Identify a cross section of clients or consumers in 
the program area. Include members of different 
ages, locations, technical abilities, etc., depending 
on the nature of the problem or service. For ex- 
ample, in the development of an employment 
service, the client group would include potential 
employers, the currently unemployed, the cur- 
rently employed, and retired people. 

1.2 Select a group (usually between 30 and 50 people) 


that will represent the client population. 


“The procedure recommended by Delbecq (1971) should be fol- 
lowed closely by the program planner and group leader. 
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1.3 Organi ii 
ganize - group meeting to discuss common 
problems in the program area. 


. Identify problems. 


2.1 Divide the group into subgroups of six to nine 
members according to a common characteristic, 
e.g., age. 

Indicate that the decision makers want to under- 
stand clients’ views. 

Instruct the group in Nominal Group Technique 
(NGT, page 14). Stress that the meeting should 
produce a list of problems—not solutions. 

Request members to list “personal” problems in 
the program area on one side of the index card and 
“organizational” problems on the other side. For 


2.2 


example, a client in the improvement program for 
an employment service may list “I do badly in oral 
interviews” asa personal problem and “the job op- 
portunity list comes too late” as an organizational 


problem. 

2.5 Let the members list ideas silently for about 30 
minutes. 

2.6 Record the generated items on a flip chart—one 
for each subgroup. 


Using the Nominal Group Technique rank-order- 
ing voting procedure, select the top five priority 
items on the flip chart. 

Explain that some members will participate fur- 
ther in development of the program. Have them 
select three or four representatives. 


. Generate program ideas. 


3.1 Identify external technical and organizational ex- 
perts whose skills relate to the listed priority 
items. Identify internal experts from the principal 
organization connected with implementation of 
the program. 

Arrange a group meeting to include these experts 
and the group’s representatives. Explain Nominal 
Group Technique to them. 

Prepare and display the list of priority problems 


kB 
cenerated by the client group and explain each 


item. 

Instruct the group to prepare a list of solution 
components and the resources required to imple- 
ment them. The list should be in two parts: 1) 
those items currently available and easily procured 
‘atitten on one side of an index card), and 2) 
-hoce items to be developed (written on the other 


side of the card). 


the members to write silently for about 


3.4 


Allow 
490 minutes. 


~~ 
tn 
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3.6 Compile the lists and display them on a large flip 

chart. 

Following a five to ten minute break, reassemble 

the group and discuss each item briefly. 

3.8 Using the rank-ordering voting procedure, select 
the components and resources considered to be es- 


3.7 


sential. 

Explain the rest of the Program Planning Method 
and have participants elect representatives for 
further sessions. 


EF 4 


4. Generate specific program alternatives. 
4.1 Identify the key administrators and resource con- 
trollers who were listed by the second group. 
4.2 Present the program ideas and instruct the group 
to work out specific alternative programs from the 
idea list. 


5. Design the program. 

5.1 Organize a meeting of representatives from client 
and expert groups, decision makers, and resource 
controllers. 

5.2 Present details of alternative programs from step 4 

y and discuss them briefly. 

Conduct nominal group voting to arrive at the 

final design. 

5.4 If a consensus or significant agreement cannot be 
reached, repeat steps 4 and 5 after a few days de- 
lay. 

5.5 The final solution should be satisfactory to all con- 


cerned. 


EXAMPLE 


Though Program Planning Method has only recently 
been developed, its use has been varied. For example, it 
was used by the Governor’s Task Force for Planning 
Health Services in the State of Wisconsin in 1972. It was 
also used by a health planning agency in Texas in 1973 to 
design health service programs. 


THEORY 


Delbecq and Van de Ven (1971) developed the Pro- 
gram Planning Method at the University of Wisconsin's 
Graduate School of Business. The method extends experi- 
mental and field research on the use of the Nominal Group 
Technique to planning processes. 

The technique is rooted in empirically derived theories 


of organizational change processes which specifically ad- 
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dress the scheduling of client participation and the utiliza- Delbecq, André L., and Van de Ven, Andrew H. “Nominal 

tion of multi-disciplinary expertise (see Delbecq, Van de Group Techniques for Involving Clients in Program 

Ven, and Gustafson, 1975). Planning.” Academy of Management Proceedings 

(August 1970). 

Delbecq, André; Van de Ven, Andrew H.; and Gustafson, 

David. Group Technique for Program Planning: A 

BIBLIOGRAFHY Guide to Nominal Group and Delphi Processes. Glen- 
view, Ill.: Scott Foresman, 1975. 

Delbecq, André L., and Van de Ven, AndrewH.“‘AGroup Van de Ven, Andrew, and Delbecq, André L. “A Planning 


Process Model for Problem Identification and Pro- Process for Development of Complex Regional Pro 
= ” ° ° . . . 
gram Planning.” Journal of Applied Behavioral grams.’”’ Graduate School of Business, University of 
Science 7 (November 1971): 466-92. Wisconsin, 1972. 
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PREREQUISITE TOOLS 


Function Expansion (FEX, page 45) and System Defi- 
nition Matrix (SDM, page 67). 
SSS 


USAGE 


PURPOSE 

The IDEALS (Ideal Design of Effective and Logical 
Systems) Strategy provides a comprehensive approach for 
solving problems by specifying systems to achieve a de- 


sired function. 


USES 
The IDEALS Strategy can be used to: 
1) Design systems and plan for their implementation. 
2) Provide a conceptual framework for studying 


problems. 
3) Generate alternative solutions toa problem. 


4) Develop products or services. 


KEY DEFINITIONS 

1) An ideal system target achieves the function in the 
best possible manner as judged by the criteria for evalu- 
ating the system. Such systems typically require the least 
possible nite? the least amount of human resources, and 


she least time while providing maximum benefits. 


Strategy 


2) Regularity is the most frequent or dominant (and 
occasionally the most important) condition of concern to 
the project design. 


SHORT DESCRIPTION 


The emphasis in the methodology is first on “why” and 
then on “how” the system operates. The function of the 
system is determined by using Function Exp.nsion (FEX, 
page 45); and an ideal system target for the units or regu- 
larity which will meet the function is developed. With this 
ideal system target as a guide, alternative systems, which 
incorporate necessary irregularities, are developed which 
are as Close to the ideal as possible. One of these is recom- 
mended for implementation, and the details are then 
specified using the System Definition Matri (SDM, page 
67). The process of implementation is stippested, and 
ueasures of evaluation are established. 


ADVANTAGES 

1) A key concept is to develop an ideal system before 
specifying the feasible solution. Thus, innuvative and ef- 
fective systems are likely to be developed, rather than 
patched up versions of existing systems or solutions. 

2) Thinking is not inhibited by the recorded charac- 
teristics of the current system. The empha:i. in IDEALS 
Strategy is on the function of the desired system rather 
than on improvement of the current system, 
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LIMITATIONS 

1) The concept of what is ideal or optimal may be dif- 
ficult for some people to comprehend and apply. 

2) The function of asystem may not be easily identifi- 
able (see Function Expansion, FEX, page 45). 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


The design process often involves a group of people 
working on a problem. The effort required is directly pro- 
portional to the magnitude and complexity of the prob- 
lem at hand. Effort is required to expand the system func- 
tion, to develop an ideal system, and to recommend the 


feasible solution. 


SKILL LEVEL 


Some knowledge about the problem area is necessary 
to solve a problem using the IDEALS Strategy. No special 
skills are necessary to understand or use the approach. Re- 
peated use of IDEALS Strategy in different contexts en- 


hances its effectiveness. 


TIME REQUIRED 


The time required is proportional to the magnitude and 
complexity of the problem being solved. Typically, less 
than a week is required for preliminary design of products, 
more than a week for service systems involving people. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


The decision maker must have knowledge of the 
problem area anda statement of the problem at hand. 

When solving a problem by the IDEALS Strategy, it 
may be necessary to use tools such as Brainstorming (BSG, 
page 3) or Cost-Benefit Analysis (CBA, page 212). Knowl- 
edge of such tools or access to an analyst may be needed. 


TOOL OUTPUT 


The recommendation of a solution is the primary out- 
put. The recommended system can be specified in the 
form of a System Definition Matrix (SDM, page 67). Use 
of IDEALS Strategy also provides insight into the prob- 
lem. 

Figure 1 gives an example of a possible output for ajob 
information system. 


FIGURE 1 
Function Hierarchy for IDEALS Strategy 


Function Hierarchy 


1. Provide list of job opportunities 


2. Communicate job opportunities to 
unemployed people 


3. Match job specifications with applicant 
specification 


“) 4. Get people and jobs toge ther* 


5. Find employment for people 


Fill vacancies in industry and government 


6 
7. Have jobs and services carried out 
8 


Get jobs done 


Provide services 


10. Keep economy functioning 


11. Promote general welfare 


*Function level selected for design of the system. 


NOTE: The hierarchy lists the functions from the most 
unique function at the top to the most general at the 
bottom. 


IMPORTANT ASSUMPTIONS 


The IDEALS Strategy assumes that when developing 
alternatives, creativity is improved by focusing on func- 
tion and an ideal situation rather than on the problems and 
limitations of the existing system. The strategy also as- 
sumes that functions can be clearly identified for all 
systems, and that ideal systems are conceivable. However, 
“deal” implies optimization, and optimizing a system for 
all possible conditions is not feasible, hence the regularity 
concept. 


METHOD OF USE 
GENERAL PROCEDURE 


1. Determine the function. 
1.1 The function of the system to be developed is 
identified by using function expansion (FEX, page 
45). A hierarchy of functions is developed, and a 
level in the hierarchy is chosen as the appropriate 
function for the system. 


1.2 Determi iteri 
: mine the measures or criteria of the system’s 
effectiveness, Select those measures considered 
necessary and important to ensure the elimination 
of unnecessary constraints and conditions in the 


design. 


2. Develop ideal systems targets, 

2.1 First, try eliminating the function chosen in step 

1 to review the necessity of the function and to 
make certain that only required Systems are de- 
veloped. Preview the function hierarchy and check 
to see if a different (usually higher) function level 
may be more appropriate. 
Identify regularities, which are the primary con- 
cern or the most frequent characteristics of the 
System. The focus on regularities addresses the 
consistency of the ideal situation. For example, in 
an irrigation project most of the dry land is on the 
north side of the river. The regularity concept 
argues for ignoring the opposite side in initial plan- 
ning. When an educational system is being de- 
signed for a region where a small part of the popu- 
lation is bilingual, the regularity concept recom- 
mends that planning begin with instruction given 
only in the language spoken by the majority. 

2.3 Develop guidelines for the ideal system target 
based on the identified function and agreed upon 
measures of effectiveness. For example, some 
guidelines developed for the design of a fertilizer 
distribution system may be “least cost of transpor- 
tation,” “‘most equitable distribution,” and “least 
consumption of fertilizer per unit of food pro- 
duced.” Differentiate between the ideal concepts 
that are feasible and those that are not currently 
feasible due to technical or theoretical considera- 
tions. Select only those ideal values that are 
feasible. 

2.4 From the guidelines above, develop appropriate 
ideal systems. Select one as the ideal system to be 
the target for subsequent design. 


tO 
NO 


3. Develop the system to be recommended. * 

3.1 Obtain information concerning the questions 
raised during the development of the ideal system 
target. Experiments or analytical calculations may 
be necessary. The purpose is to determine those 
facets of the ideal system which need to be altered 


and those which can remain as they are. 


"The ideal system target developed relates only to the regu- 
ie - 5 . 
nt ak . r regular condi- 
leriry conditions. This step takes care ef the irreg 
rs] ; while staying as close to the ideal system target as 
Ons ¢ alae 
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FIGURE 2 
Identifying Measures of Effectiveness, 
Regularities, and Ideal Concepts 


a) Measures of Effectiveness—Criteria 


Amount of delay in getting employer and 
applicant together 

Cost of arranging the meeting—for employer, 
for applicant, for the agency 

Ratio of vacancies to applicants 

Ratio of number job applicants matched to 
number of applicants 

Number of interviews per successful match 

Total number of clients served 


b) Regularities 


Applicants come to agency requiring jobs 
Applicants are unemployed 
Exception: applicants want reassignment 
Employers come to agency expressing need 
for applicants 
Exception: agency to canvas prospective 
employers 
The output of the agency is the arrangement 
of interviews 
Exception: physically bring together two 
Parties or be present at the interview 


c) IDEALS Concepts 


No delay in finding jobs for applicants or 
applicants finding jobs 

Obtain complete specification of applicant 
skills* 

Obtain complete specification of job require- 
ments* 

All jobs will have broad specifications 

All applicants have marketable skills 

Allinterviews result in jobs 

All vacancies are reported 

Minimum effort by service in soliciting jobs 

Minimum effort by service in finding applicants 


*Atnocost 
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3.2 Identify alternative systems, Group processes, 
such as Nominal Group Technique (NGT, page 
14), may be used. Selecting a feasible system close 
to the ideal target involves predicting how the 
system will perform as well as evaluating and com- 
paring different suggestions. 


4. Recommend implementation procedures. 
This step may involve testing the effectiveness of the 
system. Training personnel may be required. Establish 
performance measures for the system and guidelines 
for future changes in order to effect ongoing improve- 
ments in the system. 


EXAMPLE 


Developing an employment service in a region where 
unemployment is high is discussed in Function Expansion 
(FEX, page 45). The function hierarchy developed is given 
in figure 1. The function level selected in step 1 is “to get 
people and jobs together.” This selection allows maximum 
flexibility in generating alternative ideal systems which 
achieve the function. Criteria for evaluating the system are 
given in figure 2a. 

In step 2, regularities and exceptions in the system are 
identified (see figure 2b). A group process is used to 
generate the criteria and regularities. Guidelines for ideal 
systems are developed and listed (figure 2c). Ideal 
systems as targets are then developed. From the list of 
criteria and regularities, the following target systems are 
identified: 

1) System to find the maximum number of vacancies. 

2} System to assess marketable skills of applicants. 

3) System that eliminates interviews. 

The first two target systems reflect the need to satisfy 
criteria, e.g., having a high ratio of vacancies to applicants. 


r 


IDEALS STRATEGY / 23, 


The third system bypasses the function level “Betting 
jobs and people together” to arrive at the function leas 
“fill vacancies” in the function hierarchy. That is, the id.) 
system for the function level selected, “get people ay.) 
jobs together,” may be a system which accomplishes th, 
higher function of “fill vacancies’’ as shown in figure 1. 

System 1 is selected as target system. Part of this 
system is another system where information about avail 
able jobs is obtained. A preliminary system definition 
matrix (SDM, page 67) partially specifies the feasibl,- 
system (figure 3). 

An example of applying the strategy to information 
system design is documented in Nadler et al. (1975). Oth. 
examples may be found in health education and industiia} 


applications literature. 


THEORY 


The IDEALS Strategy was developed by Nadler (19«'') 
and has been used extensively in industry, commeie, 
public service agencies, and government. A detailed din uy 
sion of the strategy is given in Nadler (1970). 
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Planning, Programming, 


and Budgeting 


PREREQUISITE TOOLS 


Cost-Benefit Analysis (CBA, page 212). 


USAGE 


PURPOSE 

A Planning, Programming, and Budgeting (PPB) 
strategy makes evaluation part of the program selection 
process by clearly defining gouls and evaluating projected 
Outputs prior to selecting a specific program. 


USES 


PPB may be used to: 

1) Plan a program with emphasis on its goals and on 
how well each alternative meets those goals. 

2) Prepare a budger statement that lists expenditures 
and evaluates outputs according to goals, | 

3) Choose from among several projects which meet 
Program goals when resources are limited. 


SHORT DESCRIPTION 


PPB is a comprehensive planning strategy. It structures 
the decision-making process into identification of goals, 
development of programs to meet those goals, and evalua- 
tion of al 


fits). 


ternative program costs and Outputs (or bene- 


Ii 


First, the policy goals of an agency are defined, and 
then programs are developed to meet the goals. Then, 
techniques like Cost-Benefit Analysis (CBA, page 212) 
and Cost-Effectiveness Analysis (CEA, page 219) may be 
used to determine the resource costs and the projected 
outputs (benefits) of the program. Estimates of future 
resource costs and output are specified. This information 
is then included in a budget statement with the programs 

-arranged by policy goals. Decisions between alternative 
programs may be made based on the planning, program- 
ming, and budgeting goals anda cost-benefit analysis. 


ADVANTAGES 


1) PPB represents a transformation of budget planning 
based on resources and input requirements to function- 
Output oriented budget planning and decision making. 
This approach has advantages for government budget 
analysis. Resource needs are not merely listed under a de- 
partment heading; they are grouped by programs where re- 
quired. This allows a decision maker to evaluate the costs 
of each program category relative to overall goals. 

2) PPB allows the decision maker to re-evaluate on- 
going programs each budget year. Automatic continuation 
of funding is less likely, due to the improved feedback of 
performance. 


LIMITATIONS 


1) The initial step of setting goals can be difficult, 
especially for large government agencies. Because of the 
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difficulty in teaching agreement, the final goals are often 
too general to be used for developing or evaluating pro- 
grams. 

2) The necessary data collection is time-consuming. In 
addition, many decision makers feel that too much infor- 
mation is presented for effective evaluation. 


3) Many variables, Particularly the outputs, cannot be 
adequately quantified in a uniform unit measure. In social 
programs, this is especially difficult. 

4) It is difficult to show the relationships of program 
components to more than one goal in the budget state- 
ment. 

5) The PPB approach gives the tasks of program 
development and evaluation to the same decision 
maker(s). Hence, output measures most favorable to the 
program evaluation can be selected. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


PPB is a comprehensive planning technique, and more 
effort is required as the complexity of the system in- 
creases. Decision makers will often be engaged in a con- 
tinuous effort to define goals, develop programs, and 
evaluate costs and outputs. When this happens, it is neces- 
sary to collect data on costs and outputs for the next 
budget statement. 

Somewhat more effort may be required than simple 
budgeting and bookkeeping; however, PPB may be con- 
sidered an alternative to normal budgetary control. 


SKILL LEVEL 


The user needs a knowledge of systems analysis tech- 
niques like Objective Trees (OBT, page 49) and Cost- 
Benefit Analysis (CBA, page 212). Skills in accounting 
methods and cost data collection may also be necessary. 


TIME REQUIRED 
Time required depends on the complexity of the sys- 
tem to be planned, programmed, and budgeted. In many 


acencies, this is acontinuous process. 


SPECIAL REQUIREMENTS 


A PPB system may be done on a computer, asin other 
cost-accounting systems. In large organizations, com- 


suterized data-handling may be essential for effective 


planaing, programming, and budgeting. 


DESCRIPTION OF TOOL 


DEFINITIONS 


1) A program category is a system category under 
which specific projects, or program sub-categories, are 
developed; e.g., development of agriculture or health 
services. 

2) A program sub-category refers to the specific 
projects considered under a program category; e.g., a 
sub-category of agricultural development is hybrid seed 
research. 

3) Program elements are the resources or inputs 
needed to carry ona project. 


REQUIRED INPUTS 


When developing goals and measurable objectives, the 
agency or unit responsible for planning must understand 
the organization’s purpose and how other agencies cooper- 
ate within the organization. 

Knowing the resource requirements and the resources 
available and having access to cost data are necessary. 


TOOL OUTPUT 


There are four areas of information for decision 
making: 

1) The defined goals of the agency. 

2) Alternative programs to meet those goals. 

3) An evaluation of the costs and benefits of each al- 
ternative. 

4) A means for measuring the results of the program 
selected for future evaluation. 


IMPORTANT ASSUMPTIONS 


PPB assumes that well-defined goals can be agreed 
upon. Using ambiguous goal statements weakens the plan- 
ning process and the attempts to measure program results 
versus program goals, 

The results of a program must be measurable. However, 
in social programs such as health care, measuring the in- 
creased health level asa result of the program may be diffi- 
cult, if not impossible. Yet, the planning process assumes 
that the future output of a program can be adequately esti- 
mated. 

A project leader, or agency head, must contribute to 
the presentation of well-defined goals for agency programs 
and the evaluation of all program results each budget year. 
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METHOD OF USE 


GENERAL PROCEDURE 
The procedure is divided into three stages: 1) planning, 
2) decision making/implementation, and 3) review. 


Planning Stage 
1. Define the goals of the organization or institution. 

1.1 Determine the type of programs to be developed, 
and help evaluate the results of the programs. Use 
techniques such as Function Expansion (FEX, 
page 45), Objective Trees (OBT, page 49), and 
Incent Structures (INS, page 55) to identify goals. 

1.2 Initially, state goals in broad terms. Then define 
each phrase in the goal statement in more detail. 


2. Develop programs to achieve goals. 

2.1 Gather relevant information. Program develop- 
ment requires extensive knowledge of the relevant 
social and economic system and of the particular 
problem to be solved. A wide range of information 
gathering may first be required. Explore theories 
on the subject and interview experts. Other tools, 
such as Delphi (DLP, page 168) or Morphological 
Analysis (MPA, page 10), may be use fil. 

2.2 Use this information to develop programs that 
promise to achieve the defined goals. List pro- 
grams by types into different program categories. 
When a program involves more than one project, 
program sub-categories will te necessary (see 
figure 1). 

2.3 Break the program categories or sub-categories 
into program elements, the specific resources 
needed to carry on the program. 


3. Estimate needed resources (inputs). 
3.1 Estimate the cost of each program element and 
determine the average cost per project. 
3.2 Discount all future costs to the present for analysis 
and comparison on the same basis (see Discount- 
ing, DIS, page 184). 


4. Estimate outputs and benefits for each program 
category. 
Determine a unit measure of the Outputs. For ex- 
ample, an education program category requires a unit 
measure to estimate the value of a college education, 
e.g., dollars, number of persons receiving a degree, or 
number of graduates employed. Information on 
measuring outputs (benefits) can be found in Cost- 
Benefit Analysis (CBA, page 212) and the Logical 
Framework (LGF, page 260). 


FIGURE 1 
Goals and Programs for the Federal 


Economic Development Administration 


Goal: Economic Development in De- 
pressed Areas 

Specific Goal: Increased Jobs in Rural Depressed 

Areas 


Program Categories 
A. Education 

B. Public Works 

C. Business Loans 
D. Planning Grants 


Program Sub-categories 
(for Program Category B) 
B. Public Works Projects 
1. Water/Sewer 
2. Industrial/Commercial 
3. Other facilities 


Program Elements 
(for Sub-Category B.1) 

A. Water/Sewer Enginecring Plans 

B. Construction material 

C. Construction labor 


5. Evaluate program categories (or sub-categories). 

5.1 Determine which program provides the most out- 
puts for the least cost using cost-benefit analysis. 

5.2 Determine which program best meets the goals of 
the agency. This goal-related criterion for evalua- 
tion distinguishes PPB from a purely economic 
analysis (as in cost-benefit analysis). Although a 
number of programs may have a favorable bene- 
fit-cost ratio (see BCR, page 194), some programs 
achieve the stated goals better than others. 


Decision Making/Implementation Stage 


In the decision-making/implementation stage, the in- 
formation from the planning stage is presented to the deci- 
sion maker. The information will include the general and 
specific goals of the agency, possible program categories, 
sub-categories and program elements, an analysis of pro- 
gram costs and benefits, and an evaluation of how the pro- 
gram outputs achieve the goals of the agency. 


6. Select program categories and elements. 
6.1 Evaluate the above information and determine 
which projects and programs are to be imple- 
mented. 
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6.2 Set priorities and, if necessary, defer implementas EXAMPLE 


. Monitor outputs. 

7.1 Once the program is funded, set up a mechanism 
to measure program Outputs. The unit measures sub-category are shown. 
have been established in step 4, soa system of con- 
tinuous data collection is needed. 

Determine multiple indicators which may be use- 
ful in reviewing program Outputs in order to verify 
the results. An indicator will seldom cover all out- 
puts. These data will be used to evaluate the actual 
results of the program and will be used in future 


budget analysis. business. 
Another important evaluation criterion concerns who 


will receive the basic benefits. Alternative B distinguishes 
benefits to many residents in the depressed area, Particu- 
larly because of the water/sewer projects. In alternative C, 
the basic business loan is a direct benefit to only a small 
group of business people in the community. The indirect 
benefits (increased tax base and long-term employment) 


7:2 


. Develop a computer model of costs and outputs 
(optional). 

With the information gathered in steps 2-7, a computer 
model can be developed to estimate changes in the cost 
or output data and to help evaluate future program 
changes. For a more detailed discussion, see Tenzer 


(1969). 


there are budget constraints), 


tion of some Programs to the next year (e.g., if The goals and programs for a PPB system for the 
Federal Economic Development Administration are given 
in figure 1. The program is broken down into four program 
categories; the public works project is divided into three 
sub-categories; and program elements for the water/sewer 


Review Stage 


were not estimated in this example. 


FIGURE 2 
Analysis of Program Alternatives 


Alternative Program B: Public Works Project 


Average 
Investment 


per Job 


Average No. 
of Jobs 


Average Cost 
Per Project 


$1,028,000 
1,367,000 
618,000 


1. Water/Sewer 


2. Industrial/Commercial 


3. Other facilities 


3,013,000 


TOTAL 


Alternative Program C: Business Loans 


Average Investment 


per Job 


Average No. 
of Jobs 


Average Cost 
Per Project 


$366,000 


SOURCE: Raymond H. Milkman, et al., Alleviating Economic Distress: Evalu- 
ting a Federal Effort (Lexington, Mass.: D.C. Heath and Co., 1972), chapter 7. 
se p* ] ~ 
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Figure 2 presents an analysis of the second and third 
program categories. The specific goal of creating jobs has 
been evaluated. Program alternative B, Public Works Pro- 
ject, creates more jobs than alternative C, Business Loans, 
but at a greater cost of $2,000 per job. Most of the jobs in 
alternative B will last only as long as the project itself. In 
alternative C, more of the jobs should be for the life of the 
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THEORY 


PPB was originally developed by the executive branch 
of the U.S. Federal Government for agency budget pre- 
paration. [t stems from the application of a systems ap- 
proach to planning and management. The first task in the 
conventional systems analysis strategy is to identify ob- 
jectives, then to find alternative means for achieving the 
desired ends. The systems analyst then determines mea- 
sures to evaluate the alternatives and ranks the alternatives 
according to their effectiveness in reaching desired goals. 

A systems approach merges planning, implementation, 
and evaluation phases in a comprehensive system design. 
PPB represents one manifestation of the application of 
this strategy to public institutions—primarily the Depart- 
ment of Defense. It has a particular appeal to centralized 
decision makers because of the appearance of increased ac- 
countability, the implied reorganization along functional 
lines, and the image of scientific “systems” sophistication. 
This latter point is illustrated by the trend toward auto- 
mating PPB accounting and reporting procedures with 
comprehensive management information computer sys- 
tems. 

It is not clear, however, whether PPB really works as 
intended. There is considerable evidence (for the reasons 
cited in Limitations) that it does not (see Caldwell, 1973, 
and Hoos, 1972). Nevertheless, it is an important tool to 
understand because it has been widely acclaimed (see 
Hinrichs, 1969) and because it illustrates many aspects 
of the systems approach. The caution for analysts and 
decision makers is to be skeptical of any such system 
(including management information systems) until it is 
tested and evaluated on its own merits, rather than on 
the basis of unsubstantiated claims and promises. 
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Critical Path Method 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 
The Critical Path Method (CPM) is a networking tech- 


nique for planning and managing projects. 


USES Ae 
CPM aids in planning and managing the execution of 
activities in a project where the activities must be per- 
formed ina specified sequence. CPM: 
1) Identifies critical activities which require special at- 


tention from management. 
2) Assists in estimating the minimum total time 


needed to complete the project. 
3) Gives the times when activities must be scheduled 


to complete the project in the minimum time. 


4) Serves as a planning and management device to 
communicate complex procedures to staff and funding 


sources. 
5) Facilitates the construction of Gantt Charts (GNT, 


page 252). 


KEY DEFINITIONS 

1) An activity is an operation with a well-defined b. 
ginning and end, and a specific purpose. Some example 
are PREPARE QUESTIONNAIRE and MAIL QUES 
TIONNAIRE, activities which may be necessary to cor 
plete a Survey (SVY, page 36). 

2) A critical activity is an activity which, if not com 
pleted on time, will delay the entire project. 

3) The critical path is the sequence of critical activitie 
from project start to project finish that determine th 


shortest project duration. 


SHORT DESCRIPTION 

The Critical Path Method begins by describing the ac 
tivities necessary to complete the project. The time re 
quired to complete each activity is estimated, taking int 
consideration the resources available and the desired per 
formance specifications. Arranging the activities in a net 
work shows the logical sequence from start to finish (se 
figure 1). The critical path through the network is com 
puted by determining the activities which are critical t 
the timely completion of the project. From these calcula 
tions, the total time needed to complete the project ma} 
be estimated. 

The Critical Path Method can be used during the man 
agement of the project to cirect attention and resources t 


critical performance areas. 
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ADVANTAGES 


1) Using CPM for a project promotes advance plan- 
ning. 

2) CPM provides a concise framework for an ongoing 
review of project progress. 

3) The visual representation of the total project com- 
municates effectively to line personnel, funding agencies, 
and other interest groups. 

4) CPM identifies those activities that must be com- 
pleted on time in order to end the project as early as pos- 
sible. Extra attention can be devoted to these critical ac- 
tivities, or resources can be scheduled accordingly. 

5) Using CPM frequently results in a significant reduc- 
tion in project duration by avoiding unnecessary delays 
(Moder and Phillips, 1964). 


LIMITATIONS 

1) It is necessary to estimate in advance the exact 
nature and timing of each activity in the project. 

2) The fact that most activities may take less time if 
resources are shifted from other activities is not treated in 


the critical path calculations. 
3) CPM does not consider additional information that 


the project manager may have, e.g., the relative skill of dif- 
ferent workers or the expected delay in procuring some 


resources. 


4) It is tedious to manually analyze a CPM network 


containing more than 50 activities. 


5) CPM does not consider planning projects when 
there is limited availability of a particular resource. Gantt 


Charts (GNT, page 252) may be used in such cases. 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


Drafting a CPM network f. 
nificant undertaking. However, w 
fied during the planning 
the CPM network may 
which will reduce the total p 


Ir may be necessary tO UP 
course of a project. This may be done on 


monthly basis depending on the nature of the project. 


lanning effort. 


SKILD.LEVEL 

The calculations ona simple netw 
than simple arithmetic. For larger ne 
tions are no more comp 


portant. 


or a large project can be a sig- 
hen activities are identi- 
or budgeting stage of the project, 

actually provide a framework 


date the network during the 
a weekly or 


ork involve no more 
-works, the calcula- 


lex, but careful bookkeeping is im- 
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TIME REQUIRED 


The time required depends on the number of activities, 
the decision maker’s familiarity with the project, and the 
difficulty in getting accurate data estimates. Construction 
of the CPM network, analysis of critical activities, and 
computation of minimum total project time require one 
day for projects with less than 50 activities. 


SPECIAL REQUIREMENTS 

One index card (or something similar) for each activity 
is needed. Large sheets of paper may be needed to con- 
struct the CPM network for a large project. A calculator 
will be useful for chart computations. A computer is de- 
sirable for handling large project networks. Many CPM 
computer programs are available (see Moder and Phillips, 


1964). 


DESCRIPTION OF TOOL 


SUPPLEMENTAL DEFINITIONS 

1) The duration of an activity is the estimated time 
needed to perform the activity. 

2) The predecessor activity for an activity must be 
completed before the latter can start. 

3) An immediate predecessor of an activity is any 
other activity that immediately precedes it and which 
must be completed before the activity can start. 

4) The earliest start (ES) of an activity is the earliest 
time (measured from the start of the project) when an ac- 
tivity may begin, assuming that all immediate predecessors 
are completed. 

5) The earliest finish (EF) of an activity is the sum of 
its earliest start time and duration. 

6) An immediate successor of an activity is any ac- 
tivity that immediately follows it and which may not start 
until completion of the activity. 

7) The latest finish (LF) of an activity is the latest ume 
(measured from the start of the project) when an activity 
may be completed without delaying any immediate suc- 
cessor(s), thereby delaying completion of the project. 

8) The latest start (LS) of an activity is its latest finish 
time minus its duration. 

9) Slack is the amount of leeway allowed in either 
starting or completing an activity. Slack can be computed 


in two ways: 


Slack = LS — ES [1] 
Slack = LF — EF [2] 


which is simply the differences between the latest and 


earliest starts [1] or finishes [2]. 
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10) A milestone isa point in time (specific date) which 
marks the completion of a sequence of activities or the be- 


ginning date for subsequent activities. 


REQUIRED INPUTS 

The Critical Path Method requires knowledge of the 
project objectives, and the activities necessary to achieve 
them, in order to estimate the duration of the different 


activities and construct the sequence. 


TOOL OUTPUT 

The CPM gives the minimum total project duration 
based on the identification of the critical path. The critical 
path calculations determine the leeway in scheduling each 
activity: the time interval designated by the earliest and 
latest start times and the earliest and latest finish times. 
This information enables the project manager to deter- 
mine scheduling priorities and concentrate efforts on the 
critical activities, those activities which have no scheduling 
leeway or slack. 

The CPM is the first step in preparing a Gantt Chart 
(GNT, page 252) for examination of any potential prob- 
lems in allocating resources to the project. 


IMPORTANT ASSUMPTIONS 


All activities necessary to complete the project are 
known during the planning phase. All activities identified 
as necessary must be completed, i.e., there is no provision 
for alternative choices of action contingent upon later in- 
formation or actions beyond the control of project plan- 
ners. One may prepare alternative networks for each con- 
tingency (see Contingency Analysis, CGA, page 147). 

The time estimates for each activity are determinate, 
i.e., CPM does not permit variation in estimating duration. 
The durations estimated for each activity are assumed to 
be independent of the other activity durations. Resources 
required to complete any activity are not constrained (see 


Davis, 1966). 


METHOD OF USE 


GENERAL PROCEDURE 


Describing network techniques may be complicated, 
depending on the level of abstraction. This procedure is an 
easy approach for relatively simple networks: the analysis 
proceeds directly on the network. Other procedures which 
use a complex notation to represent the activities are not 
necessary unless the procedure is to be carried out ona 


computer, 


1. Identify and list all activities necessary to complete 
the project. 

1.1 Briefly describe each activity in the center of an 
index card (see figure 2). 

1.2 Examine the activities and discard or modify 
any which are too detailed when compared with 
the other activities. 

1.3 Give each activity an identifying number, e.z., 
10, 20, 30, etc., leaving intervening numbers for 
activities which may be included later. 


2. Estimate the duration of each activity. 
2.1 Consider the normal level of resources available 
~* tocomplete the activity. 
2.2 Consider the desired specifications for the ac- 
tivity ’s performance. 
2.3 Write the duration at the bottom of each ac- 
tivity card (see figure 2). 
2.4 List che activities and their durations (figure 3). 


3. Draw the project network. 
3.1 Place the activity cards on a large sheet of paper. 
3.2 Arrange the activities in their logical sequence 
from left to right, and fasten the cards to the 
paper. 
3.3 Use arrows to connect each activity to its im- 
mediate predecessors and immediate successors 


(see figure 4). 
FIGURE 2 
Activity Card with Location of Notations 
Milestone Activity 
Earliest Activity Description Earliest 
Start (ES) Number Finish (EF) 
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3.4 Check the network for the logical consistency 
of activity sequences. 


A 


Enter each activity’s immediate predecessors 
and successors in the table (figure 3) using their 
identifying numbers. 


4. Identify the PROJECT START and the PROJECT 
STOP. 


4.1 


4.3 


If the project begins with several simultaneous 
activities (each having no immediate predeces- 
sors), then place a PROJECT START card on 
the network and connect it with arrows to these 
activities (see figure 1). This activity has zero 
duration. 


2 If the project ends with several simultaneous ac- 


tivities (each having no immediate successors), 
then place a PROJECT STOP card on the net- 
work and connect it with arrows to these activi- 
ties. This activity has zero duration. 

Assign a reference time of zero to the desired 
starting date of the project. 


5. Determine each activity’s earliest start (ES) and 
earliest finish (EF). 


| 


i 


mn 


5.4 


a2 


5.6 


LB al 
| 


Begin with PROJECT START and work for- 
ward through the network. 

Set the ES for the PROJECT START equal to 
zero. 

Compute the EF for each activity by adding the 
duration to its ES. 

For each sequential activity with only one im- 
mediate predecessor, set the ES equal to the 
predecessor's EF. 

For each sequential activity with more than one 
immediate predecessor, set the ES equal to the 
latest EF of the predecessor activities. The ES 
of an activity is the earliest time (measured 
from the start of the project) that an activity 
may begin assuming that all immediate prede- 
cessors are first completed. Therefore, the ES 
can be no earlier than the EF among the pre- 
see figure 4). For example, if 
ded by activities A, B,andC, 
ies may be 


ceding activities ( 
activity D is prece 
and if the earliest that these activit 
finished is 4, 2, and 3 weeks from project start, 
respectively, then the earliest that activity D 
may start ‘5 the fourth week of the project, 1.e., 


ES = 4 
Write th 
activity card 


3 ES and EF on the top corners of the 
(see figure 2) and enter in the table 
(figure 3). 

Repeat steps 2 
SCT STOP is reached. Note, the 


hrough 5.6 until the PROJ- 


ES for an activ- 


——— 
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ity may be calculated only after the EFs of all 
immediate predecessors have been determined. 


6. Determine each activity’s latest start (LS) and latest 
finish (LF). 


6.1 


6.2 


6.3 


6.4 


6.5 


6.6 


6.7 


Begin at the PROJECT STOP and work back- 
ward through the network. 

Set the LF for the PROJECT STOP equal to its 
EF; 

Compute the LS for each activity by sub- 
tracting the duration from its LF. 

For each activity with only one immediate suc- 
cessor, set LF equal to the LS of the successor 
activity. 

For each activity with more than one im- 
mediate successor, set the LF equal to the 
earliest LS of the successor activities. The LF of 
an activity is the latest time (measured from the 
start of the project) when an activity may be 
completed without delaying the project. Con- 
sequently, the LF must be no later than the LS 
times for all the activity’s immediate successors 
(see figure 4). For example, if activity D is im- 
mediately followed by activities E and F andif 
the latest that these activities may begin is 10 
and 9 weeks, respectively, then the latest that 
activity D may finish is the ninth week of the 
project, 1£., LF = 9. 

Write the LS and LF on the bottom corners of 
the activity card (see figure 2) and enter in the 
table (figure 3). 

Repeat steps 6.3 through 6.7 until the PROJ- 
ECT START is reached. Note the LF for an ac- 
tivity may be calculated only after the LSs of all 
immediate successors have been determined; 
hence the necessity to pass backward through 


the network. 


7. Compute the slack times for each activity. 


7.1 


Y 


fog 


7.4 


8. Iden 
8.1 


Slack is zero for an activity with identical ES 
and LS or identical EF and LF. 

Otherwise, slack is simply the difference in time 
between the ES and LS or between the EF and 
LF of each activity. 

Write the slack at the bottom of each activity 
card {see figure 2) and enter it in the table. 
Check the calculations for each acti-ity by add- 
ing the duration and slack to the earliest start 
time. The sum should give the latest finish ame 


for the activity. 


tify the critical path for the project. 
Any activity with zero slack is critical, Mark the 


status in the table (figure 3). 
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8.2 The sequence of critical activities from start to 
finish is the critical path for the project. (There 
may be more than one critical path.) Mark the 
critical path on the network diagram with heavy - 
lines on the connecting arrows and/or by 
shading the critical activity cards in the se- 


quence. 


9. Determine the duration of the project. 

9.1 Examine the sequence of activities to see if all 
activities are necessary, or if the project method 
might be changed (Mulvaney, 1969). 

2 Examine the activities on the critical path to see 
if they might be shortened in duration. 
Consider the application of additional resources 
to shorten critical activities. 

.4 Consider a change in specified performance of 
the activity to shorten the estimated duration. 
Finally, take the duration of the project as the 


9.5 
"EF of the final activity or PROJECT STOP. 


10. Use the project network to manage the project. 

10.1 Assuming the project is to be completed as early 
as possible, set the calendar date of the PROJ- 
ECT START at the earliest feasible time. This 
becomes the time reference for scheduling all 
subsequent activities. 

Schedule every activity to start in its ES to LS 
time interval. Note that there will be no leeway 
in scheduling critical activities. 

If days are the basic time unit, schedule accord. . 


10:2 


10.3 
ing to calendar working days (unless overtime is 
authorized). 

If a deadline for completion of the project has 
been set and if resources and staff are not avail- 
able until the last minute, set the PROJECT 
START date by subtracting the total project 
time from the deadline. 


10.4 


10.5 Write in significant milestones on the network 
using the elapsed time from the date of the 
PROJECT START. Milestones usually mark the 
latest finish date for several simultaneous activ- 


ity sequences. 


EXAMPLE 
Though the Critical Path Method is most useful for 


Projects involving 50 or more activities, a simpler example 
illustrates the technique: a planning seminar which brings 
experts together with donor agency representatives. 
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Identify and List All Activities 
Necessary to Complete the Project 


perts and the arrangement of financing, facilities, and 


travel. These activities are listed in table form (see figure 
5). All activities involve about the same level of derail, ie., 
minute specification of tasks is omitted at this stage. Many 
other activities may be necessary to plan a particular 
seminar, but only six tasks are shown in order to simplify 


the example. 


Estimate the Duration of Each Activity 
The durations shown in figure 5 are in time units of 
weeks. These are estimates based on the number of experts 
and donor representatives involved in the seminar and :ne 
staff available to complete the activities. 


Draw the Project Network 

The activities are written on index cards and arranced 
in a logical sequence (see figure 1). Initially, the network 
may look rather confusing with many arrows criss- 
crossing. Sometimes rearranging the activity cards and re- 
drawing connecting arrows will clarify the diagram. If 
crossing two arrows cannot be avoided, usea “‘bridze”’ for 
clarity. 

Check the network for consistency. Is the activity se- 
quence logical? Can activities sequenced one after the 
other be performed simultaneously? Activities 10 and 30 
are illustrative. 

The immediate predecessors and successors of all activi- 
fies are noted in the table (see figure 5). 


Identify the PROJECT START 
and the PROJECT STOP 

In this example, it is necessary toadd botha PROJECT 
START and a PROJECT STOP activity as the project be- 
gins and ends with simultaneous activities. The final ac- 
tivity is not HOLD THE SEMINAR since the project is 
completed when arrangements for the seminar are 
finished. This includes setting a date (which may be in 
several months). 


Determine Each Activity’s 
Earliest Start and Earliest Finish 

Computation of the earliest start and finish is shown 
directly on the top corners of each activity card (see figure 
6). For example, activity 50, ARRANGE FOR DONOR 
REPRESENTATIVE’S TRAVEL, is preceded by activ- 
ities 10 and 60 which have earliest finish times of one and 
five weeks, respectively. Since activity 50 may start only 
after all preceding activities are finished, its ES is five 

weeks from the starting date of the project. 
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Determine Each Activity’s 
Latest Start and Latest Finish 

These times are computed directly by working back 
through the network (see figure 6). For example, activity 
60, ARRANGE MEETING TIME AND PLACE, has three 
immediate successors, activities 40, 50, and 80 (the PROJ- 
ECT STOP). These activities have latest starts of five, six, 
and seven weeks, respectively, from the starting date of 
the project. Since activity 60 must finish before the fol- 
lowing activities can begin, the latest finish is five weeks . 
from the PROJECT START. 

The latest start time of the PROJECT START is com- 
puted as zero. This provides an easy check of the computa- 
tions for all activities. 


Compute the Slack Times for Each Activity 

The slack for each activity is shown on the activity card 
and in the table (figure 5). Activity 30 has the largest 
slack—four weeks. Since its ES is week zero and its LF is 
week five, experts may be identified during any week in 
this time period. This task has been estimated to take only 
a week, but it would be wise to schedule it as early as pos- 
sible (even though there are four weeks of slack). 


Identify the Critical Path for the Project 
The activities with zero slack are noted in the table 
(figure 5) by writing ‘‘critical” under the status column. 
The critical path is shown on the network by shading the 
critical activity cards and darkening the connecting arrows 


(see figure 6). 


Determine the Duration of the Project 

The earliest finish of the last activity is seven weeks 
from the PROJECT START date. Upon examining the 
critical path, one may conclude that the most likely place 
to shorten the time is to expedite the arrangements for 
financing. However, since this is largely beyond the plan- 
ner’s control, the total estimated completion time Is seven 
weeks, the EF for the PROJECT STOP. 


Use the Network to Manage the Project 

me for the project is to be December 4 
When the activities with slack are scheduled, the geben 
is finished (note that the table, figure 5, is not a schedu e). 
vity 40 is selected asa key event in 
the project and the milestone date crn pri 
directly on the network diagram (sce figure 6). The pr ng 
manager assigns staff roles to each task and monitors p 


ess against the planned performance. Construction of a 
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to the date of the conference may be appended to the net. 
work to give the total picture. However, it is usually good 
practice to start with a network that identifies the ees 
activities and then to redo the network with a finer break- 


down. 


THEORY 


The Critical Path Method (CPM) and Project Evalua- 
tion and Review Technique (PERT) were both developed 
in the late 1950s (Moder and Phillips, 1964). Originally, 
the CPM network technique considered the costs of 
shortening critical activities and thus optimized the timing 
of the task. PERT permitted three time estimates (pessi- 
mistic, optimistic, and most likely) for the duration of 
each activity. PERT allowed the planners to estimate a 
date for project completion, including his confidence in 
the variance of the estimate (Bedworth, 1973). 

Subsequently, these two techniques have been ex- 
panded and modified, and many other network tech- 
niques have been developed. Davis (1966) gave an excel- 
lent survey of the treatment of resource allocation in net- 
works. Pritsker and Happ (1966) developed a method 
which considered the probability of certain activities not 
occurring (a limiting assumption of CPM). 

From the beginning, network techniques have been 
programmed for digital computers. Moder and Phillips 
(1964) listed some of the many versions. Efforts to 
simplify the technique for manual computation draw 
from the desirable features of both PERT and CPM as well 
as Gantt or Bar Charts. Mulvaney (1969) gave an excellent 
treatment which serves as the model for this tool descrip- 


tion. 
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Gantt Charts 


PREREQUISITE TOOLS 
Critical Path Method (CPM, page 241). 


USAGE 


PURPOSE 


The Gantt Chart facilitates planning and managing 
project activities and resources. 


USES 


The Gantt Chart is used to: 

1) Plana project to schedule activities. 

2) Communicate the project plan to others and to 
mark milestones in the project sequence. - 

3) Determine the minimum project duration, given 
that some resources may be limited. 

Project managers may use Gantt Charts to schedule re- 
sources and staff assignments and to record actual progress 
against the planned performance of activities. 


SHORT DESCRIPTION 
A Gantt Chart displays the schedule of project activi- 


ties (see figure 1). Each activity is represented by a bar that 
extends along the time scale. The bar’s length is propor- 


tional to the duration of the activity. The position of the 
bar along the time scale indicates the starting and ending 
times for the activity. 

The required amount of a limited resource (e.g., man- 
power) may be tabulated for each unit of time to allow for 
a direct examination of scheduling problems. Activities 
may be shifted to keep the total amount of the resource 
within the limit. 


ADVANTAGES 


The primary advantage of the Gantt Chart is its sim plic- 
ity and intuitive appeal. It is a popular scheduling device 
because the timing of each task is clearly indicated. 

The critical path or sequence of critical activities is re- 
vealed on a Gantt Chart by direct inspection; there will be 
no leeway in scheduling these activities if the project is to 
be completed ina minimum time. 

Allocation of a limited resource can be explicitly 
treated on the chart, and activities can be rescheduled or 
resources shifted from one activity to another. 

Milestones may be marked to clearly show important 
intermediate stages of the project. The project’s progress 
may be marked directly on the Gantt Chart: if preceding 
activities are not completed at the corresponding mile- 
stone, then corrective action is indicated. For example, 
the 20th working day after project start isa milestone fora 
survey project (see figure 1). 
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LIMITATIONS 
The Gantt Chart does net emphasize the logical se- 
quence of activities as clearly as the network diagrams in 


the Critical Path Method (CPM, page 241). 
If more than one resource is limited, the Gantt Chart 


technique does not ensure an optimum resource alloca- 


tion. 


REQUIRED RESOURCES 


SKILL LEVEL 


As in any project planning technique, developing a 
Gantt Chart requires breaking downa project into its logi- 
cal and distinct activities. It also requires estimating the 
duration of activities and resource requirements. Since 
there is a tradeoff between resources allocated and the 
duration of an activity, these tasks are enhanced by re- 
peated practice in constructing charts and comparing esti- 


mates with actual progress. 


TIME REQUIRED 

The time required is directly related to the complexity 
of the project to be scheduled. Experience in estimating 
resource requirements and task duration shortens chart 
construction time. Gantt Charts often require updating 
during project implementation. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


Knowledge of the activities necessary to complete a 
project is the precondition for developing a Gantt Chart. 
The dates for starting and ending the project fix the time 
scale of the Gantt Chart. Resource needs and availability 
must be specified. 


TOOL OUTPUT 


The primary output is a project schedule depicted by a 
Gantt Chart. The Chart can then be used to mark the prog- 
ress of the project and to adjust it according to manage- 
ment decisions. 


IMPORTANT ASSUMPTIONS 


The Gantt Chart construction assumes that a project 


may be broken down into clearly distinguishable activities 


ING, AND EVALUATING PROJECTS 


with a definite beginning and end; that is, the time to com- 


plete each activity can be accurately determined curing 


the planning phase. 
The Gantt Chart technique does not enable optimum 


allocation of resources—more sophisticated techniques are 
required (Davis, 1966). However, the technique is useful 
for graphically sequencing activities to avoid exceeding 
the amount of a limited key resource. This assumes that 
the interaction berween required resources and the dura- 
tion of an activity can be specified (e.g., if additio nal man- 
power is assigned to the activity, is the duration short- 
ened). Determination of the minimum project duration 
using a Gantt Chart is depending on these relationships 


(see Bedworth, 1973). 


METHOD OF USE 


GENERAL PROCEDURE 


A Gantt or Bar Chart is constructed by identifying all 
the activities involved in the project and determining their 
sequences. Each activity is drawn asa bar located ona time 
scale so that the length of the bar corresponds to the dura- 
tion of the activity and the position of the bar denotes its 
scheduled start and end (see figure 1). 

The following procedure concentrates on constructing 
a Gantt Chart as a heuristic technique for taking into ac- 
count the requirements for a limited resource. As such, it 
extends the Critical Path Method (CPM, page 241). 


1. Construct the CPM network for the project. 
1.1 Diagram the network in order to observe the logi- 
cal sequence of project activities. 


1.2 Compute the earliest (ES) and latest starts (LS) for 
each activity and the earliest (EF) and the latest 
finishes (LF) for each activity. 

1.3 Compute the slack for each activity and determine 
the critical path. 

1.4 Estimate the minimum project duration. 

1.5 Estimate how much of the limited resource is 


necessary for each activity. 


2. Construct the Gantt Chart for an unlimited resource. 
2.1 Mark off a horizontal time scale approximately 
one-third greater than the estimated minimum 
project duration. (If the time unit is in days, then 
include only working days unless overtime is con- 
sidered.) 


Draw a horizontal bar for the first activity lying on 


i) 
WN 


the critical path by starting at the zero reference 
on the time scale and extending to the estimated 
duration of the activity. 


2.3 


2.4 


2o7 


tv 
oo 


Deaw a bar on the chart which corresponds to the 
duration of the next activity on the critical path. 
The beginning of the bar must fall on the same ver- 
tical time line as the finish of the preceding ac- 
tivity. The bars may be drawn in the same row of 
the chart or in different rows to facilitate identifi. 
cation of the activity (see figure 1). 

Continue adding bars consecutively until all the 
critical activities in the path are represented on the 
chart. 

Make certain that the end of the bar for the last 
activity falls on a vertical line on the time scale 
which equals the estimated minimum project 
duration. 

Add the activities not on a critical path to the 
chart. The position of the bar is determined by the 
earliest start and earliest finish times of the project 
activity. 

Append a bar tothe right end of each non-critical 
activity. The length should equal the slack for the 
activity (see CPM, page 241). 

Draw vertical arrows between the ends of the bars 
to show the predecessor activities for each activity 


(see figure 1). 


Determine resource requirements. 
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Write the amount of the limited resource required 
for each activity directly on the bar. 

Starting with the first time unit on the scale (e.g., 
day 1 or week 1), add the amount of the limited 
resource used in all activities scheduled at that 
time and enter it in the column below the chart 
(see figure 1). 

Continue calculating the total resources required 
for the rest of the time units. 

Sum these unit totals to give the total resource re- 
quirement for the project. 

Divide this total by the number of time units to 
give the average resource requirement per unit of 
time (e.g., man per day, secretaries per week, com- 
puter hours per month). This gives an indication of 
how uniformly the limited resource is used by the 


scheduled activities. 


Adjust the schedule for the limited resource. 


+.1 


rd the amount of the limited resource which 


Reco 
‘. available for each time unit of the project (see 
figure 1). | | 
Compare this to the rotal resource re quiremen 


estimated for each time unit. 
If the amount of resource required exceeds the 


amount available, then the schedule for that time 


unit must be shifted. 
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4.4 Within the constraints posed by the logical se. 
quence of activities, shift activities forward or 
backward along the time scale so that the total re- 
sources required do not exceed those available. 

4.5 Consider lengthening the duration of non-critical 
activities to reduce their resource requirement. 

4.6 If necessary schedule two simultaneous activities 
to follow each other sequentially. 

4.7 Extend the total project duration, if necessary, to 
avoid exceeding resource limitations. 

4.8 Make certain after any modification of the original 
schedule that no activity has been shifted such 
that it starts before all predecessor activities are 
finished. 


5. Use the Gantt Chart to manage the project. 

5.1 Indicate the significant milestones by drawing a 
vertical line through the appropriate date. 

5.2 Consider the scheduling of activities with slack: if 
the activity is scheduled for the earliest start time, 
the slack will all occur at the end; if the activity is 
scheduled to start at the latest possible time, the 
activity will become critical to avoid delays in sub- 
sequent activities (and the project). 

5.3 Assign staff and other resources to each activity 
and discuss the schedule and expected perfor- 
mance. 

5.4 Develop a reporting system which can be used to 
mark the progress and completion of each activity 
on the chart. 

5.5 Provide for a periodic staff review of project ac- 
tivities to emphasize the interdependency of the 
work. 

5.6 If the project fails to meet the schedule, update 
the chart and, if necessary, recalculate the critical 
path for the remaining activities. This process is 
facilitated by providing space on charts to add ac- 
tivities and to expand or shift the time scale. 


EXAMPLE 


A simple Gantt Chart illustrates the activities required 
to design and executive a survey (SVY, page 36). The 
example is adopted from Moder and Phillips (1964). 


Construct the CPM Network 
for the Project 
The survey task was broken down into eight activities, 
and the CPM network was constructed (see figure 2). The 
earliest and latest starts and finishes and the slack for each 
activity were calculated on the network and tabulated ‘see 
figure 3). The minimum duration for the project was esti- 


mated to be 36 days. 


a — 2S 


FIGURE 2 
Critical Path Network for Survey Project 
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The limited resource for this example was the staff 
available for planning and conducting the survey. The 
manpower necessary for each activity was determined (see 


figure 3, colo 4). 


Construct the Gantt Chart 
for an Unlimited Resource 
The Gantt Chart is shown in figure 1. The scale is in 
working days. Note that the slack for non-critical activities 
is shown directly on the time scale. This chart represents 
an early start schedule since the slack period always fol- 
lows each activity. 


Determine Resource Requirements 
The total resources for each day were tabulated. The 
total requirement for the project was 81 man-days; the 
average daily requirement was 2.44 men. 


Adjust the Schedule 
for the Limited Resource 

No more than three staff members are available during 
the project. Though this exceeded the average require- 
ment, a comparison with the Gantt Chart (figure 1) re- 
vealed that four men are needed on days three through 
eight of the schedule. Hiring personnel to conduct the sur- 
vey and designing and drafting the questionnaire could not 
be scheduled concurrently. All three staff members were 
needed to draft the questionnaire and the duration of that 
activity remained as estimated. Five days of slack followed 
the hiring of personnel; this task’s manpower requirement 
could be halved and the duration doubled without delay- 
ing the project. Yet, the resources required would still 
have exceeded those available by half a staff person per 
dey. Assuming that the job of hiring personnel could not 
be delegated to another part of the organization, the only 


remaining choice was to reschedule the two activities so 


thet they no longer overlapped. 

The revised schedule required a minimum of 41 days, 
but the manpower requirement remained within the limits 
for the entire project period (see figure 4). The average 
ment was just under two men. Activity 


daily staff require r, io ee 
became a critical activity in this 


B, HIRE PERSONNEL, 


schedule. 


Use the Gantt Chart 
to Manage the Project 
o the Gantt Chart at 25 work- 


Milestones were added t . 
April 


inc days, or May 11, assuming the project bezan on 
7sF : ay oe 1 , : ; 
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ress as of May 4 (20 working daysafter the project began) 
was shown on the chart by cross-hatching the status of 
each activity. Note that household selection had not 
started, and attention was given to getting that task under- 
way. However, it was not necessary to redraw the Gantt 
Chart since there was sufficient slack to complete this task 
without delaying the project. 


THEORY 


The construction of a Bar Chart to illustrate the 
schedule of project activities originates from management 
practice rather than froma complex theory. However, the 
Gantt Chart technique as described here draws from two 
theoretical areas: network scheduling techniques (see, for 
example, Moder and Phillips, 1964) and resource alloca- 
tion theory (see Davis, 1966, for a review of relevant 
theory). 

The Gantt Chart technique described in the general 
procedure section constructs a time-scaled CPM network; 
that is, a network in which the length of the connecting 
arrows shows the duration of the activities. 

The Gantt Chart provides a graphic record-keeping for- 
mat for schedulinga limited resource. It does not provide a 
means for optimum allocation of scarce resources as this is 
beyond a trial and error approach. The technique has been 
described as heuristic and, as such, is more an art thana 
science (see Mulvaney, 1969, and Bedworth, 1973). 
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Logical Framework 


PREREQUISITE TOOLS 


None. 


USAGE 


PURPOSE 


Logical Framework enables the decision maker to 
identify project purposes and goals and plan for project 
outputs and inputs. 


USES 


The Logical Framework has been used widely by 
USAID Missions to: 

1) Aid in planning a project. 

2) Provide measures to evaluate a project. 

3) State assumptions about causal linkages. 


KEY DEFINITIONS 


1) The purpose of a Project is its primary intention or 
aim; it is the reason why a project is designed. 

2) The goal of a projectisa value judgment which satis- 
fies one or more human needs. A program or sector goal is 
the broader objective to which a project contributes. 

3) The outputs of a project are the desired and unde- 
sired results of the transformation process of a system, 


e.g., patients leaving a hospital, cured or not, are the re- 
sults of a health delivery system. 

4) The inputs of a project are the people, information, 
and/or physical items which enter the system to be trans- 
formed by a sequence into the outputs of the system, e.g., 
for an agricultural development project, inputs may be 
seeds, money, etc. 

5) The sector is the larger system of which a project is 
part, e.g., building a dam is a project in the agricultural 
sector. 

6) Objectively verifiable indicators demonstrate that 
certain desired results are being accomplished. 

7) Means of verification are the specific mechanisms 
by which quantitative indications of the accomplishment 
of a project may be observed. 


SHORT DESCRIPTION 


The decision maker uses two types of logic to arrive at 
explicit statements which serve to help in planning or in 
evaluating a project in progress. 

A vertical logic clarifies why a project is being under- 
taken. It specifies the program or sector goal, and project 


purposes, outputs, and inputs. 

A horizontal logic identifies what is to be produced and 
the evidence that will signal success. It lists objectively 
verifiable indicators, means of verification, and important 
assumptions. Figure 1 presents the basic format for the 
Logical Framework. 
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ADVANTAGES 

1) The Logical Framework is simple to understand. It 
provides a structure for concepts, ensuring that the deci- 
sion maker thinks through the fundamental aspects of a 
project design. 

2) The framework aids in evaluating a project since 
both initial goals and final results are clearly delineated 
(similar to the System Definition Matrix, SDM, page 
67). By explicitly identifying how the project is to be eval- 
uated, the decision maker can make realistic estimates of 
project outcomes and can identify problems which might 


be encountered. 


LIMITATIONS 

1) During the planning process, the Logical Frame- 
work does not take uncertainty into account. Neither does 
it allow for the consideration of potential alternative 


actions. 
2) A linear causal sequence is assumed which is an un- 


likely simplification of the relationships among various 
project components and elements in the environment (see 
Oval Diagramming, OVD, page 81). 


REQUIRED RESOURCES 


LEVEL OF EFFORT 


The decision maker must define the project goals, pur- 
poses, inputs, and outputs in measurable or objectively 
verifiable terms. Thus, while the Logical Framework may 
guide the planning process, it is not a substitute for the 
considerable effort required to plan effectively. 


SKILL LEVEL 


The decision maker must be able to think logically and 
to consider the important attributes, both quantitative 
and qualitative, of the project. 


TIME REQUIRED 


Completing the Logical Framework takes from several 
days to several weeks, depending on the size of the project. 


DESCRIPTION OF TOOL 


REQUIRED INPUTS 


The decision maker needs to identify the project which 
is part of a program or sector. The success of a program 
depends on the success of the various projects carried out 


within that program or sector. 


Other tools may be used to complete the Logical 
Framework. The objective tree (OBT, page 49) can help to 
structure goals, purposes, and criteria for evaluation. To 
explore the links between inputs and outputs, interaction 
matrix diagrams (IMD, page 92) would be useful. To de- 
velop a more thorough structure of a system, the System 
Definition Matrix (SDM, page 67) can be used. 


TOOL OUTPUT 


The completed Logical Framework matrix is one out- 
put of the technique. The other is the contribution that 
the process makes to the project design or evaluation. By 
thinking through the horizontal logic, crucial hypotheses 
about causal linkages may be determined. Developing the 
horizontal logic forces the planner to think in terms of 
realizable results. The Logical Framework then serves asa 
statement which, to some degree, indicates the complete- 
ness and soundness of these analytical processes. 


IMPORTANT ASSUMPTIONS 


Underlying any planning technique of this sort is an as- 
sumption of the inherent rationality of project inter- 
ventions. One need only identify the causal linkages from 
inputs to outputs to purpose, and the project has been de- 
signed systematically. Yet it is not a systems design neces- 
sarily, since systems seldom exhibit exclusively linear 
causality. There are interactions with environmental com- 
ponents, feedback relationships, and complex relation- 
ships among the elements of the system. Thus the Logical 
Framework assumes a simplicity qualified only by entries 
in the “assumptions” column. 


METHOD OF USE 
GENERAL PROCEDURE 


The recommended procedure is based on the work of 
Rosenberg and Hageboeck (1973) and the Office of Pro 
gram Evaluation, USAID (1974). The vertical logic (col- 
umn 1 in figure 1) clarifies why a project is being under- 
taken. It characterizes a project asa set of linked hypoth- 


a If we provide the following inputs, 


then we can produce the requisite outputs. 
If we produce those outputs, 

then the purpose will be achieved. 
If the purpose is achieved, 

then the goal will be realized. * 


“Leon J. Rosenberg and Molly Hageboeck, “Management Tech- 
nology and the Developing World,” in Systems Approaches to 
Developing Countries, Proceedings of the Symposium sponsored 
by IFAC and IFORS, May 28-31, 1973, Algiers, Algeria. 


FIGURE 2 
An Example of a Logical Framework 


OBJECTIVELY 
VERIFIABLE 
INDICATORS 


IMPORTANT 
ASSUMPTIONS 


MEANS OF 
VERIFICATION 


NARRATIVE SUMMARY 


Assumptions for 
achieving goal targets: 


Measures of 


Program or sector goal: goal achievement: 


Provide universal (a) Degree of (i) Questionnaires Ability of 
education geared shortage/surplus to major industries economic sector to 
to needs of Temasek in various professions provide jobs predicted 


(ii) Companson in 10-year plan 
of number of 
students graduated 
with objective in 


10-year plan 


Assumptions for 
achieving purpose: 


Measures of 


Project purposes: purpose achievement: 


Ability of primary 


(i) Demographic 
and secondary schools 


(a) Number of students 
from rural and urban 


1. Meet the educational 
needs of arural 
agricultural community 


data 


in rural areas to 
provide students 
with an adequate 
foundation for 
tertiary education 


areas proportionate to 
the population of 
potential students 


(b) Research and 
course directions in 
School of Agriculture 


(ii) Opinions of 
leaders of rural 
interest groups 


Assumptions for 
providing outputs: 


Magnitude of outputs: 


Outputs: 
Data collection 


1. Students with 
by university 


degrees in: 

Agriculture, 500/year.. . 
Science, 100/year 
Engineering 200/year 


Assumptions for 
providing inputs: 


Implementation target: 


Inputs: 
1. Faculty Type Quantity Data collection Brain drain is cut 
2. Students PhD in Ag. 9 by university by half in five years 


MS in Ag. 5 
MS in Science 5 


3. Scholarship program 


PhD in Engr. 
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1. Complete the vertical logic. 
Determine at each lower level the conditions which are 


necessary and sufficient to achieve the next upper level 
(see figure 1). The inputs must be necessary and suffi- 
cient to produce all the outputs; the outputs must be 
necessary and sufficient to achieve the purposes, etc. 
For example, for the construction of irrigation canals 
covering 2,000 acres (output), there could be several 
inputs: ‘20 shovels,” “farmer support,” and an “irri- 
gation engineer.” The analyst must be sure that each 
input is necessary to achieve the construction of the 
canals. He should determine if the inputs are sufficient 


or if some are missing. 


2. Complete the horizontal logic. 

2.1 At each level of the vertical logic, complete the 
three part horizontal logic. Determine: 

a) Objectively verifiable indicators which de- 
monstrate that the desired end has been 
accomplished. 

Means of verification, or specific mechanisms 

through which accomplishment is objectively 

verified. 

c) Important assumptions which affect the suc- 
cess of the project. Here, the project designer 
explicitly identifies the uncontrollable factors 
that may affect project success. 

Consider objectively verifiable indicators which 

may or may not be quantifiable. The two step 

“clarification of evidence” involves identifying 

first the indicator and then the means of verifica- 

tion. The project designer is encouraged to mea- 
sure what is important, rather than what is easy to 


b) 


measure. 
Follow each of the vertical logic levels through the 


horizontal logic. For instance, after the purpose of 
the project has been established, fill in the condi- 
tions which indicate that the purpose has been 
achieved according to the means of verification. 
There may be many indicators which point to suc- 


oud 


cess at the purpose level since a single indicator is 
seldom sufficient to signal success. 
2.4 State the assumptions which underlie the achieve- 


ment of the project purpose. 


EXAMPLE 

Consider the educational sector in the country of 
Temasek. Currently, there is a National University in 
Bandar Besar, the capital, which is attended mainly by 
students from urban areas. The northern rural areas, with 
strong agricultural needs, do not receive enough agricul- 
tural education from this university. A project is under- 
taken’to establish a university at Bandar Kechil to serve 
that area’s needs. Figure 2 shows a partially completed 
Logical Framework for this project. 


THEORY 


The Logical Framework technique is based on a sys- 
tems planning model. The vertical logic closely relates to 
the System Definition Matrix (SDM, page 67). Some theo- 
retical work has been done on identifying social indicators 
and objectively verifiable indicators (see, for example, 
DeGreene, 1973). 
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Glossary 


ACTION STUB. That portion of a decision table which lists the actions or decisions to be taken if a 
particular combination of circumstances occurs (DTB). 

ACTION-EVENT PATH. The sequence of alternative actions and relevant events represented by 

the branches in a decision tree (DTR). 

ACTIVITY. An operation with a well-defined beginning and end and a specific purpose (CPM). 

AND LOGIC ELEMENT. Links sub-objectives to objectives where all sub-objectives must be 
achieved in order to attain the higher level objective(s) (INS). 

ANNUAL CASH FLOW. The net incremental benefits for each year of a project and the difference 

between the incremental benefits and costs (CFA). 

ASSESSOR. A person who estimates the probability distribution of a set of events (SPA). 

ATTRIBUTE. The elements or components of the system and the interrelationships among them 
(MPA, SCN). , 

AXIOLOGICAL MEASUREMENT. Involves value judgments, where the data necessary to deter- 

mine accomplishment of an objective are gathered via subjective methods (OBT). 

BASE SYSTEM STATE. The set of current conditions which describes the essential characteristics 
of the scenario (SCN). 

BINARY-EVENT OBJECTIVE. An objective that either clearly occurs or does not occur (OBT). 

BRANCHING RULE. A rule that governs the construction of relationships in a tree diagram 
(TRD). 

CAUSAL CHAIN. A sequence of cause and effect relationships between variables (OVD). 

CAUSAL LOOP. A causal chain which is connected so that a change in any variable eventually 
feeds back through the chain to affect this variable (OVD). 

CENSUS. A survey of all members of a subject population (SVY). 

CENTRAL TENDENCY. The most likely, or average value of the variable (HIS). 

CHECKLIST. Used in design or analysis where items are marked or otherwise noted item by item 
(SDM). 

CLASS INTERVAL. A uniform division of the variable range (HIS). 

CLOSED QUESTIONS. Questions which require the respondent to limit responses to prespecified 
categories (QTN). 

CLUSTER SAMPLE. The process of randomly selecting several clusters of subgroups from the 
total population and surveying all members of the selected subgroups (SVY). 

CLUSTERED DATA. Used to aggregate the data into fewer points for analysis and plotting (HIS). 

COMPONENTS. An entity in a system which may be elemental, or it may be a subsystem having 
distinct components (SDM, TRD). 

CONDITION ENTRIES. The conditions of each factor (or question) listed in the condition stub 
(DTB). 

CONDITION STUB. That portion of a decision table which lists the factors to be considered when 
making decisions in a given situation. Each factor is written in the form of a question (DTB). 

CONTINGENCY. A particular combination of factors that describes a future environment (CGA). 

CONTINUOUS MODEL. A model which treats variables thet change continuously over time 
(CSM). 

CONTINUOUS VARIABLE. Takes on an infinite number of values over some range of possible 
values (HIS). 

CONTROL DIMENSION. Evaluates and regulates any element’s specification. This dimension 
measures each element as the system operates, compares the measure to what is designed or 
desired, and takes action if the difference is greater than desired (SDM). 

CORRELATION. An observed relationship between two or more variables in which the changes in 
one variable may be associated with predictable changes in another; the relationship, how- 


ever, is not necessarily cause-effect (OVD). 


268 / GLOSSARY 


CORRELAT 7 
IVE BEHAVIOR. An assumed relationship between two Or more variables in which 


the ch i 
ane sealant be associated with predictable changes in the others (RGF). 
: activity which, if not completed on time, will delay the entire project 
(CPM). y one 
CRITICAL PATH. es 8 ; 
| The sequence of critical activities from project start to project finish that deter- 
mine the shortest project duration (CPM). 
CROSS- ; 
INTERACTION MATRIX. A representation of relationships between dissimilar sets of 
variables (IMD). 
DECISION RULES. The action entries of a decision table which link a particular combination of 
condition entries to specified actions (DTB). 
DECISION SYMBOL. Represents a step in a process where there is a choice among two or more 
alternative actions (FLW). 
DEPENDENT VARIABLE. The variable being forecast (RGF). 
DESCRIPTIVE MODEL. A representation or imaginary entity containing information in a prede 
fined form, intended to be interpreted by its user rules (SDM). 
DETERMINISTIC MEASUREMENT. Where the realization of the objective is unequivocally de- 
termined from numerical data (OBT). 
DIMENSION. Collections of attributes of the system, where each collection represents a major 
aspect of the system (SCN). 
DIRECT ANALOGY. Compares the problem being faced to a parallel situation in another field, 
technology, or discipline (SCN). 
DIRECT ANALOGY METHOD. Used in Synectics sessions when members compare the problem 
being faced toa parallel situation in another field, technology, or discipline (SYN). 
DIRECT EFFECT. An interaction between two variables so that achange in one results in a similar 
change in the other (OVD). 
DIRECT MARKET VALUES. Measures of project costs or benefits which are assessed from equiv- 
alent market prices (IPX). 
DIRECTED LINE. Links two symbols together with an arrowhead indicating the sequence (FLW). 
DIRECTED RELATIONSHIP. Specifies that the existence of the relationship is dependent on the 
order in which the two elements are considered (IMD). 
DISCOUNT FACTOR. A fraction between 0 and 1 which gives the present worth of one monetary 


unit spent or received (DIS). 
DISCOUNT RATE. A percentage rate (usually annual) which equates the present and the future 


worth of a payment (DIS). 

DISCOUNTED CASH FLOW. A single value which represents the present worth of the net incre- 
mental benefits estimated for each project year (NPW). 

DISCRETE STOCHASTIC MODEL. A model which describes the changes in variables at definite 
points in time (CSM). 

DISCRETE VARIABLE. A variable with only a finite number o 
basic unit (HIS). 

DRIVING FORCE. An attribute of a system which 
(SCN). | 

DUNNING. The process for recontacting P 
naires (DLP). Pa 

DURATION. The estimated time needed to perform the activity (CPM). 

DYNAMIC BEHAVIOR. A consequence of delayed interactions among system variables. The 
dynamic state of a system depends on the prior values of state variables (OBT, RTS). 


EARLIEST FINISH (EF). The sum of an activity’s earliest start time and its duration (CPM). 

EARLIEST START (ES). The earliest time 
ity may begin, assuming all immediate 

ECONOMIC ANALYSIS. Analysis from th 
omy (CFA). 


f values which are multiples of a 
causes changes in the system state over time 


articipants who have failed to return their question- 


predecessors are completed (CPM). 


(measured from the start of the project) when an activ- 


e viewpoint of the national government and the econ- 
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EFFECTIVENESS. The degree to which the project or system design objectives are achieved 
(CEA). 

ELEMENT. Part of a problem situation which can be described by all its elements (MPA). 

ELSE RULE. A column in a decision table which applies when no other decision rules may be 
added to cover the case or where nocombination of conditions applies (DTB). 

EN VIRONMENT. The set of all factors which are salient to the understanding of systems relation- 
ships, but which are outside the influence of the system variables (OBT, SDM). 

EVENT. A future outcome, the occurrence of which is uncertain (SPA). 

EXTERNAL CONTEXT. Represents the constraints on the base system (SCN). 

FANTASY ANALOGY. The participant’s wishful thinking that the problem may solve itself or 
cease to exist (SYN). 

FEEDBACK STRUCTURE. The set of relationships describing a system that involves one or more 
interlocking causal loops (OVD). 

FINANCIAL ANALYSIS. Analysis from the viewpoint of the individual, group, or business which 
will directly gain or lose because of the project (CFA). 

FREQUENCY DISTRIBUTION. Plots the frequency of different categories of response (QTN). 

FUNCTION. The primary concern of the system. It is the fundamental dimension of purpose 
'(FEX, IDL, SDM). 

FUNCTION HIERARCHY. An ordering of system functions from the most specific to the broad- 
est (FEA? 

FUNDAMENTAL DIMENSION. The basic characteristic of the eight system elements (SDM). 

GOAL. A value judgment which satisfies one or more needs (FEX, LGF, SCN). 

GOVERNING RULES. Describe the relationships between decisions made by the participants ina 
game and the resulting changes in the simulated environment (GAM). 

HIERARCHY. An ordered structure illustrating which factors are subordinate to others (TRD). 

HUMAN AGENTS. The personnel who may be necessary for the system to achieve its function, 
yet are not themselves inputs or outputs of the system (SDM). 

IDEAL SYSTEM. A system that achieves the function in the best possible manner as judged by the 
criteria for evaluating the system. Such systems typically require the least possible cost, the 
least amount of human resources, and the least time while providing maximum benefits 
(IDL). 

IMMEDIATE PREDECESSOR. Any activity which immediately precedes an activity and which 
must be completed before the activity can start (CPM). 

IMMEDIATE SUCCESSOR. Any activity which immediately follows an activity and which may 
not start until completion of the activity (CPM). 

IMPORTANT ASSUMPTIONS. The factors which affect the success of a project and which are 
beyond the influence of the decision maker (LGF). 

INCREMENTAL COSTS AND BENEFITS. Computed by subtracting the “without project” 
values from the “with project” values (CFA). 

INDEPENDENT VARIABLE. The non-random variable which is used for forecasting other vari- 
ables using regression (RGF). 

INFLUENCE RELATIONSHIP. When one variable’s change in value influences change in another 
variable (TRD). 

INFLUENCE TREE. A tree that diagrams the variables which influence other variables which are 
higher in the tree (TRD). 

INFORMATION CATALYSTS. The communication (written or verbal) and the knowledge which 
enable the system process to occur, yet which are not inputs or outputs of the system 
(SDM). 

INPUTS. The people, information, and/or physical items which enter the system to be trans- 
formed by a sequence into outputs of the system (LGF, SDM). 

INTERACTING GROUP. A process that permits discussion among participants (NGT). 

INTERFACE DIMENSION. The relation to other systems or elements—a linking entry torelated 
system definition matrices (SDM). 


270 / GLOSSARY 


INTERMEDIATE IMAGE. An intermediate ima 
interval n (SCN). 


INTERNAL ECON ; 
rp OMIC RETURN. The rate of return derived from an economic analysis of the 

INTERNAL FINANCIAL the society or economy of the country (IRR). 

IAL RETURN. The rate of return derived from a financial analysis of the 
project cash flow (IRR). 

Gir vos Scales that reflect not only the rank of one factor over another, but the 

ogree.te ich one exceeds the other. The difference between them corresponds toalength 
of scale interval (RTS). 

INTERVIEW SCHEDULE. The plan for conducting an interview. It includes the questions to be 
asked (IVW). 

INVERTED EFFECT. An interaction between two variables so that a change in one results in an 
opposite change in the other (OVD). 

IRREVERSIBLE VARIABLE INTERACTION. When the variable only increases or only de- 
creases (OVD). 

LATEST FINISH (LF). The latest time (measured from the start of the project) when an activity 
may be completed without delaying any immediate successor(s), thereby delaying comple- 
tion of the project (CPM). 

LATEST START (LS). An activity’s latest finish time minus its duration (CPM). 

LIMITED ENTRY. A type of decision table which permits only a limited set of condition and 
action entries in the decision rule columns (DTB). 

LINEARLY LINKED MATRICES. Matrices with acommon set of rows or columns (IMD). 

LOGIC ELEMENT. A symbol indicating the nature of the relationship between two or more ob- 
jectives at adjacent levels in a hierarchy (INS). 

LOGICAL INCONSISTENCIES. When hypothesized relationships among variables are inconsis 
tent (OVD). 

LOGICAL MEASUREMENT. Determines whether a binary-event objective has or has not oc- 
curred (OBT). 

MATRIX. A mathematical and graphical representation in two dimensions (IMD). 

MATRIX ENTRY. The symbol used to indicate the existence or absence of arelationship between 

and the element in the column (which together define the entry) 


ge describes the state of the system after a time 


the element in the row 
(IMD). 

MEAN. The average value or central tendency of the data (HIS). 

MEANS OF VERIFICATION. The specific mechanisms by which quantitative indications of the 
accomplishment of a project may be observed (LGF). 

MEANS-ENDS ANALYSIS. The identification of alternative actions t 
(OBT, TRD). -s 

MEASURING INSTRUMENT. A technique for elicitin 
(OCA, SVY). . 

MEDIAN. The value corresponding to the midpoint of the data points (HIS). a 

MILESTONE. A point in time (specific date) which marks the completion of a sequence of activi- 
ties or the beginning date for subsequent activities (CPM). 

MIXED ENTRY. A type of decision table which permits extended entries such as a range of values 
for a question in the condition stub (DTB). 

MODE. The value or class interval which occurs most frequently (HIS). a 

MODEL A representation of an imaginary entity that contains information in a certain predefined 
form and has specified cules for interpretation (TRD). 3 

MULTIPLIER EFFECT. Occurs when a project impact on one aspect of an economic system gen- 
erates a stimulating effect on other aspects fr 

ING. Draws random samples in stages | 

pee 6 eT VARIABLES. Variables that occur when a change in one variable causes a 

change in another which is fed back to affect the first (OVD). 


o achieve specified ends 


g and measuring responses from a subject 


(SVY) 


. 
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MUTUALLY-EXCLUSIVE PROJECTS. Incompatible alternatives where implementing one pre- 
cludes implementing the others (NPW). 

NOMINAL GROUP. A group process in which the members wor 
other’s presence (NGT). 

NOMINAL SCALES. Scales that categorize different factors (RTS). 

OBJECTIVE. A specific statement of purpose expressing a desired end (INS, O 

OBJECTIVELY VERIFIABLE INDICATORS. Indicators that demonstrate t 
results are being accomplished (LGF). 

OPEN QUESTIONS. Questions which permit the respondent to answ 
(QTD). 

OPPORTUNITY COST. The cost of committing resources to a particular use as measured by the 
highest return that could have been obtained by committing the same resources to an alter- 


k independently but in each 


BT). 
hat certain desired 


er as he or she chooses 


native use (DIS). 
OR LOGIC ELEMENT. Links objectives where the attainment of any one ora combination of 


sub-objectives will achieve the higher level objective (INS). 

ORDINAL SCALES. Scales used to rank-order a set of similar objects along acriterion dimension 
which reflects a basis for comparison, but not the degree of difference (RTS). 

ORGANIZATIONAL ATTRIBUTES. The elements or components of an organizational system 
and the interrelationships among them (OCA). 

ORGANIZATIONAL CLIMATE. The relatively enduring quality of the internal environment of 
an organization that (a) is experie nced by its members, (b) influences their behavior, and (c) 
can be described in terms of the values of a particular set of characteristics (OCA). 

ORTHOGONALLY LINKED MATRICES. Matrices with the same set of elements in the rows of 
one matrix and the columns of the other matrix (IMD). 

OUTPUT. The desired and the undesired results of the transformation process of a system (FEX, 
LGF, SDM). 

OWNER. An organization or person who possesses intent for, or has a vested interest in, a project 
(INS). 

PARAMETER. A quantity with only one value over the entire range of the system behavior being 
simulated (CSM). 

PARTICIPANT OBSERVATION. The gathering of information about and impressions of a se- 
lected group by direct interaction over an extended period of time (SVY). 

PAYOFF VALUES. Represent the gain resulting from the occurrence of a particular action-event 
path (DTR). 

PERIOD. The time interval between successive observations of the underlying process (EXF). 

PERSONAL ANALOGY METHOD. Used in Synectics sessions where a group member identifies 
with an element of the problem and looks at it as though he were that element (SYN). 

PHYSICAL CATALYSTS. The equipment, facilities, etc. which are necessary for the inputs to be 
transformed into outputs, but which are not themselves inputs or outputs of the system 
(SDM). 

POLICY. Long-range decisions which influence a large number of diversified groups with different 
values. Policy made at one level of an institution forms the guiding criteria for shorter-range 
decisions at a lower level (INS). 

PREDECESSOR ACTIVITY. An activity that must be completed before another activity can start 
(CPM). 

PRESENT WORTH. The value today of a future payment (DIS). 

PROBABILISTIC MEASUREMENT. Occurs when the attainment of the objective may not be 
determined with certainty (OBT). 

PROBABILITY DENSITY FUNCTION. Represents the probability distribution of a set of contin- 
uous events (SPA). 

PROBABILITY DISTRIBUTION. Associates each event in the set with its probability of occur- 
rence (SPA). 


—" 
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PROBLEM ENVIRONMENT. The set of vari ; : 
Lechierioeeenie: say pope's =~ and relationships which are germaine to the 

PROCESS i i 

ay SYMBOL. Represents an action which takes place over time (FLW). 

ODUCER-PRODUCT RELATIONSHIP. Wh able 
- When one variable is a product of the other (TRD) 

PROGRAM CATEGORY. A System category under which specific projects, or pro é b 
categories, are developed (PPB). Dnt See 

PR Oe REN ei indie The resources or inputs needed to carry ona project (PPB). 
RAM -CATEGORY. Refers to the specific projects considered under a program cate- 
gory (PPB). 

PROJECT BER GLENCY. The ratio of project outputs to inputs (BCR, CEA). 

PURPOSE. A project’s primary intention or aim (LGF). 

QUALITATIVE OBJECTIVE. Objectives that are judged subjectively to determine if they have 
been accomplished (OBT). 

QUANTITATIVE OBJECTIVE. An objective that represents a quantifiably verifiable end or re- 
suit (OBT). 

RANK-ORDERING. The process of weighing one item against others and then ordering the items 
by weight on a scale such as importance or priority (BCR, NGT, NPW, PPM). 

RATE DIMENSION. The performance measure for a system element (SDM). 

RATIO METHOD. Estimates probabilities for a set of events by first obtaining the relative chance 
of pairs of events for all possible pairs (SPA). 

RATIO SCALE. An interval scale for which the dimension of comparison hasa natural zero point 
(RTS). 

REDUCED MATRIX. A matrix formed by omitting one or more rows or columns from the origi- 
nal matrix (IMD). 

REFLEXIVE RELATIONSHIP. Occurs when the variable interacts with itself (IMD). 

REGRESSED VARIABLE. A variable is regressed on another when the former is dependent on 
the latter (RGF). 

REGRESSION COEFFICIENT. The coefficient of the independent variable in a regression equa- 
tion (RGF). 

REGULARITY. The most frequent or 
of concern to the project design (IDL, FEX). 

RELATIVE CHANCE. Reflects whether one event will occur rather than another (SPA). 

RELEVANCETREE. A tree that diagrams the relationships among different sets of factors at each 


level of a hierarchy (TRD). 
ROUND-ROBIN. A process for serially recording ideas where each participant provides an idea in 
turn. No discussion occurs, although the leader may ask for a show of hands on how many 
ada similar idea. Those responding then eliminate that idea from their respec- 
process may continue in a circular fashion until all participants’ lists are ex- 


dominant (and occasionally the most important) condition 


participants h 
tive lists. The 
hausted (NGT). 

SAMPLE. A subset selected froma subject population, 
true for the total population (SVY). 

SAMPLE STATISTIC. A quan titative parameter 
tion from which a set of data are drawn (HIS). 

SCORING. Used in games as feedback to the participan 
sions (GAM). 

SECTOR. The larger system of 

SELF-INTERACTION MATRI 


MD). 
dei y which the inputs are worked on, transformed, or processed into out- 


SEQUENCE. The process b 
puts, usually with the aid of catalysts (SDM). 


SET. A collection of elements having some common property (IMD). 
SET OF CONTINUOUS EVENTS. Consists of an infinite number of events (SPA). 


the attributes of which are assumed to hold 
which characterizes some aspect of the popula- 


ts toreflect the effectiveness of their deci- 


which a project is part (LGF). 
X. A representation of relationships within a single set of variables 
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SET OF DISCRETE EVENTS. Consists of a finite number of mutually-exclusive events (SPA). 


SHADOW PRICES. Adjusted market prices which reflect the true benefit or cost to the economy 
(CFA). 

SIMPLE RANDOM SAMPLE. A sample made so 
an equal probability of selection (SVY). 

SLACK, 3 son as allowed in either starting or completing an activity (CPM). 

SMOOTHED VALUE. Anestimate of the average value of the variable being forecast (EXF). 

SMOOTHING CONSTANT. A fraction between 0 and 1 that indicates the degree of confidence 
placed on the most recent datum (EXF). . 

SOLUTION COMPONENT. The part of a program that is proposed as the solution (PPM). 

STANDARD DEVIATION. The measure of the dispersion of the data values about the mean 
(HIS). Ht 

STATE DIMENSION. A specification of anticipated changes and plans in specific time horizons 
for each of the four dimensions (SDM). 

STATE SCENARIO. Describes conditions and events ( 
context) ata single future point in ume (SCN). 

STATE SYMBOL. Represents a tangible product, requirement, or speci 
with a process sequence (FLW). ' 

STOPPING RULE. A rule that determines when any branch of the tree diagram should end (TRD). 

STRATEFIED SAMPLE. A sample that selects a proportional sample at random from each of the 
groups in a stratification of the total population (SVY). 

SUBJECT POPULATION. The set of all events or entities which possesses certain specified 
characteristics (SVY). \ 

SUBJECTIVE PROBABILITY. A quantified judgment of the chance of an event occurring (SPA). 

SYMBOLIC ANALOGY METHOD. Describes the problem by objective and impersonal titles. 
These titles are used to identify other problems which may be described by the same title. 
They are generally expressed in two words, usually describing two conflicting attributes of 
the problem (SYN). 

SYMMETRICAL RELATIONSHIP. Occurs when the relationship between two elements is non- 
directed (IMD). 

SYSTEM. A collection of components which interact to achieve acommon function (CEA, CSM, 
FEX, IDL, SCN, SDM, TRD). 

TARGET GROUP. A set of persons with certain common characteristics (DLP, OCA). 

THRESHOLD EFFECT. When one variable does not change until the other variable changes signif- 
icantly (OVD). 

TIME PREFERENCE. The general preference of individuals for present over future receipts and 
for future over present expenditures (DIS). 

TOTAL CASH FLOW. The sum of ail annual cash flows for the life of the project;an undiscounted 
measure of the aggregate change expected from implementing a project (CFA). 

TRANSIENT SCENARIO. Forecasts changes in and the alternative actions on a system at various 
stages in the evolution of the system (SCN). 

TRANSITIVE RELATIONSHIP. Requires that « directed relationship among three or more ele- 
ments be consistent (IMD). 

TREE GRAPH. A set of linked elements where only one exists between any two factors (OBT, 
TRD). 

TUNING. The process of making changes in the parameters and initial values for variables in order 


that every member of the target population has 


the state of the system and the external 


fic condition associated 


to minimize the errors between expected and actual simulation output or between observed 
or simulated data (CSM). 

UTILITY. A quantitative expression of the worth or satisfaction associated with an outcome 
(DTR, MCU). 

UTILITY FUNCTION. Associates the possible levels a criterion may take with the utilities for 
those levels (MCU). 


274 / GLOSSARY 


UTILITY MATRIX. Presents the elements of a decision under certainty (MCU). 

VALIDATION. Testing whether a computer simulation program simulates the observed system 
behavior. It is a process of simulating the past and checking the simulated data against actual 
data (CSM). 


VARIABLE. A factor used to describe a system which may change value as a function of time 
(CSM, OVD). 

VERIFICATION. Testing a computer simulation program to see that the program functions as 
intended. It is a process of eliminating logical errors in the program (CSM). 

XOR LOGIC ELEMENT. Links mutually exclusive sub-objectives to the higher level objective(s). 
The achievement of one sub-objective alone achieves the higher level objective (INS). 
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